Yeah, I hear you OafFish and actually I can relate to that quite a lot.
The mind is a complex thing obviously and everyone has their own set of 'unique'... traits which have to be taken into consideration, so for me in that regard, I said to myself (and this could be relevant to your wanting to attend the group): I'm just going to do what my heart is telling me to do in the hopes that it will work out well in the end. It might be really good and I may come away smiling quite a bit, or it may completely do my head in and shatter me - but I will find out. I have to do it. And if it doesn't go well then basically contemplate a new approach to, in your case, ending the loneliness.
And always try to frame these experiences in a positive light (as best you can) , I think it's good for the self esteem OafFish. You didn't ask for advice, sorry, but that's how I go about it. And I can live myself either way, whatever happens.