I can understand your feeling hurt and lonely. That isn't any fun.
Try to keep in mind that just because you're attracted to him, that doesn't mean if you were to have a sexual relationship it would be great. When personal feelings are one-sided, the experience can be very painful emotionally.
He sounds like a pretty decent guy in that he hasn't taken advantage of your physical attraction to him. Many young guys are more than willing to take advantage whenever they can! (I know that I'll probably get boo'd for that remark, but I sure have seen it happen MANY times.) If your only interest in this guy is physical, then maybe you should end the relationship now. Otherwise, it's just going to be painful for you and frustrating for him.
Gentle hugs sent your way........