It does sound like he is not a talker, has trouble with closeness and pressure to talk on other people's terms. I would assume that is how he is and that it is not about me. I would decide if I could deal with that, just be casual and have a relationship on his terms or whether I should find someone else who is more talkative. I had a guy when I was in college like that; he would ask me out maybe once a semester or even less often and we would go out and do really really great things for the whole day and have a wonderful time, etc. but then nothing. I don't know why he was like that, whether he had other girls he did that to or was not interested in dating or what. But it was him and what he invited me for so not like I could really do anything about it; make him invite me for other things or more often, etc. If the other person can't connect well, not a whole lot we can do?