Neat insight! I did a similar thing with my T I think.

I realized 7+ years into therapy this last time that I'd always been uncomfortable at other people's houses (hated babysitting as a teen, for example) because when my father first married my stepmother (I was just 5) she'd take me around to all her friends and relatives and leave me with new "cousins" etc. and it was piggyback to my father raising me alone for a year after my mother's death and having to figure out what to do with me when he couldn't watch me (work and my brothers were in school) and couldn't get a sitter.

I was/am still uncertain that someone is going to "come back" and pick me up and/or, in the case of my stepmother, she was still new to me so it wasn't particularly safe yet with her much less some other adult, "aunt" or not, whom I was just meeting? I had to have a lot of faith but didn't have much choice so couldn't "break down" so I'm still uneasy going to someone else's house alone, prefer they come to mine. I'm afraid I'll be left there (wherever "there" is! :-)