Yes and no. I end up punching myself - usually in the head or jaw as hard as I can rather than a wall. Have hit a few walls though as well with my hand, but that is usually done with my head.
I am sorry you have that much anger and pain inside that it comes out sideways this way. Can you get a stress ball to use with your hands instead of hitting? Or maybe a punching bag? I use the stress ball and that does help - as long as I don't throw it at something!