Hi, jakee, and welcome to Psych Central!

I suspect you are correct that what happened between you and your mom might be making you fearful. If need be, then talk to a counselor about it. My concern would be that your fear might drive your girl away, making it a self-fulfilling prophecy.