I'm socially awkward but still have things to talk about with the few people with whom I'm somewhat close. It sounds like the two of you are not socially anything. There is a difference between being shy or fumbling with words, and having nothing to talk about with someone most of the time. Chemistry creates a sort of magnetic social attraction where two people can talk about their day and their thoughts and enjoy it. If that chemistry isn't there, then it's like talking about your day with a stranger, which most people don't do.