I feel like at the end of the day it will still be your choice that will matter most. I am sorry to hear that you have been stress out with the opinion of the members of this community, maybe they are just concern.
Also, don't jump into a conclusion not just yet if you feel like he completes and makes you happy then there's nothing wrong to give it a try. We have so many
what ifs the reason a supposed to be good relationship ends without any label.