I don't see any real evidence that he's doing anything deserving of your suspicions and paranoia. It is understandable based on your past but you gotta focus on what you have and what he DOES DO. What ifs are killers in these situations. You can "what if" your way right into a break up if you're not careful.

I would not leave the relationship because it doesn't sound like you only have your issues that are causing this fear. I can't say for sure but based on what you've said it sounds like it's internally based.

If he's being a good guy and faithful and still with you in spite of your issues, please, do get some therapy if you aren't already, get better and get yourself stable for him. it will be worth it in the long run and I'm sure he'll be even more in love with you when you do.

good luck! You can get better.
*hugs*
~s4