I've always questioned the idea if I can live with someone else. The reason is exactly what you are describing. I am socially anxious, but I also like to be alone and do things only by myself, I am not interested in the talks that others chit-chat about all the time, I have my own ways in doing things, and I need my time and space to do whatever I want whenever I want. But I guess the sex and emotion parts don't make things that easy.