It's natural to miss him, if only because he's been there for so long. I also understand the "wasted time" thinking. I've felt the same way in the past and feel the same way about my relationship with my wife, right now we are seperated, but I invested a number of years into our relationship. It may work out in the future, it may not, but either way, no matter how much time each of us invested in the relationship, it's not worth wasting MORE time if both of you aren't happy. There is always one that is more in love than the other and it sucks for that person (in my case I think it's me, she may say otherwise idk LOL) but in the end it is better for both of you. You can't change his feelings about you, even if you don't agree with them, the best thing you can do is accept them and move on, try again. You will find someone that is emotionally supportive and appreciates your support and company in return.

He may also realize he's an idiot for treating you that way and come back, but be cautious, I wouldn't want your heart being broken again in the future.