Yes, it can be draining. How about, not being there for them, outside of group gatherings? Sounds like you are being the 'guy friend', to these women? Am I reading this wrong?