Well now you are giving us a little more context. It sounds like, with this man in particular, he was taking pleasure in you not having a GF right now. I can understand wanting to distance from someone who, rather than celebrate the good things, points out what THEY think it lacking. It does sound to me like you're working on health relationships because you said you weren't trying to have a gf right now for those reasons of not wanting to hurt others (or at least that's what I interpreted).