Ugh, that is hard...having our beloveds hang out with people we don't altogether trust...

It gets better with time, IMO. Eventually I learned my S/O wouldn't do anything nasty behind my back. Extending your trust to her is part of building it up.

I have to say, drinking never helped me forget anything, especially not gnawing worry.