Your not doing anything wrong. If anything, you are doing more than you should be here. He probably just needs time. I bet if you were to leave him alone for awhile and hang out like its no big deal, he would be like....

I know you are hurting. No one wants to be treated this way. I hope things work out soon for you.....