Sounds like he is trying to tease / flirt with you in some way. Remember when you were little and boys used to pull your hair? Sometimes guys think a fun dynamic (girls too, I guess) is for them to do stuff like that... You are supposed to get all giggly / squealy 'I told you I have a man! Silly man! My man is a great great man!' Blah blah blah about your man. Or similar.

Or... You could just roll your eyes and walk away.

Or... You could ask him how's his wife.

I don't know. People ik. Shame they can't see you are uncomfortable and stoppit already.