It's okay if something means more to you than it does to him. Sometimes something might be more important to him than to you.

Try turning the situation around. Just tell him (or reiterate) that at least for you, today is important to you. And tell him you would like to do something special for the both of you (i.e. watch the sunset, go out to dinner, cook a special dinner together, watch a movie together, cuddle together, etc.). Find a way to compromise so that your needs are met w/o too much expectations on him.