Omg that is so upsetting
I'm sorry but this sounds very ignorant of the party in question, if it's making you feel insecure then perhaps it best to confront him or question the relationship?

Sorry to hear this