I wonder if he doesn't have Aspergers or something similar or just simply doesn't understand how to interact appropriately. Not that it makes it ok or diminishes your feelings over what happened-just offering a different opinion.

I'm dating someone with Aspergers and he does do and say things are come across as mean and offensive, but I realize that he never means any of that the way it comes across.

Of course, if this is this guy's issue, he needs to take responsibility for learning to socialize better if he wants to date.