Sorry if I missed it already, but have you told him or tried to discuss any of it with him?

I apologise for being blunt, but I lack sympathy for any man who takes advantage of a woman in any way, excuses or not. He would have to be blunt as an eraser not to even remotely notice you aren't exactly willing. Sex is the most intimate, close thing you can do with another person, if he can't notice something is wrong, then something is WRONG.