Well, I can only comment with the information I am privy to, which is only from this post. But going off of that, it seems rather immature of him to not at least give you the opportunity to explain why you chose as you did. Refusing to listen to your side of the story and only responding with "I hate you" is both childish and rather rude, if you ask me.

Again, that's only going off what I know, but if he's not going to at least allow you to explain yourself, I'm not sure you've lost too much in him, you know? I absolutely don't believe that you should feel like an idiot. You've tried to be polite to him and explain your decision, and he's refused that. That is in no way your fault.

I hope I was of some help. Keep your chin up, and know that you've done the right thing here.