I don't think this is an instance of having cake and eating it, too. I think you deserve respect just like anyone else. So, if he's got some issues he needs to work on them instead of taking them out on you. Of course, I know how some people can be stuborn like that.

I don't know your relationship but if you feel comfortable talking to him about it, try that. Or, if not.... I really don't know. That's not something easy to have to live with.