Hi Cynical. Sounds like that encounter is causing anxiety. I think being a loner is ok if that is really what you want. You may want to decide what your boundaries are with other people.
You can also visit the relationship forum for ideas.