Seems to be a fear based reaction to something. Fear of being intimate, close? Fear of his attention? Maybe it reminds you of something that you are not comfortable with. Can you talk to him about it? good luck and sending kind thoughts your way---