Your brother made his plans before you notified him you wished him to attend. If I had made plans like that and my nephew then announced something he wanted me to attend, I would respond as your brother has.

Let it go.