Just going to step in here to provide a bit of a counterpoint.

Now, I'm no relationship expert but it seems to me that just one aspect of a relationship, in this case sex, shouldn't be a "deal-breaker." Leaving someone just because there's no sex seems a bit... callous to me.
Naturally, you know this guy best. If you feel like there might be a chance for the relationship to improve with some work from the both of you, maybe consider not just up and dumping him. There are a million other ways to make people feel loved and excepted other than sex, maybe you could encourage more of this? Or perhaps some couple's therapy could be an option?
It sounds to me like this guy has had some serious issues with sex in his life and condemning him for that alone just doesn't seems like the best option.
As I said, you know him best. If you truly feel as if he will make no effort on his end to improve things and that he genuinely does not appreciate you (taking into account appreciation beyond the sphere of sex) then yeah, go ahead and move on.

Just my two cents...