I think your friends and family are right. There are people out there who will accept you as you are, past included. This guy is always going to be hanging that over your head. I hope you can overcome your fears and do what is right for you.