I don't think you should be upset if you said not to exchange Valentine's gifts and he took you at your word. Personally, I take people's words at face value and don't think it's fair for other people not to.

However, the anger thing would really bother me. A bad temper is something I don't deal with well.

I guess at this point you have to evaluate if you're getting what you need from this relationship. If not, it may be time to end it.