I’d think about asking your mother the question Bill3 posited - because, unfortunately, you’re right when you say it seems like a punishment. I found this article that might be useful to you. Based on what I read in it, your idea to write a letter to your brother is a good one:
Identifying Stonewalling And How To Deal With It | Betterhelp