Yes you made things clear there, thanks I think it would be helpful to discuss this with him if you haven't already. He needs to know about your underlying insecurity and esteem doubts and how this thing with his family is affecting you. I think any resolution is going to have to involve a lot of cooperation from him. I wish you well.