It makes complete sense to me that you have these irrational fears. To you, they may seem quite rational. I have this same problem. For me, just about every guy who I've been with has cheated on me and so it's only natural that I think they will cheat, ya know?

But I have found someone (finally) who isn't like that and who I can trust.

I think that if you let your wife know the type of struggle you are having and why may open the door to both of you working through this together. That way you won't feel so alone.

Hang in there.