Good job on no benzo's. I was off them for almost a year. She put me back on a pretty small amount for night time if needed for restless leg syndrome, which is miserable. I was med free 6 months when the rls started last August. There's a possibility it was caused by the benzo withdrawl which can last quite some time. Your current anger could be a lot of things, benzo withdrawl yes still, a sign of depression, or add or mania to name a few. I can get very agitated and angry during hypo or mania. I don't like when my mind won't stop.
There's a website benzobuddies for people getting off benzo's. I did not find any good support buddies there but there was a lot of good info. If you may want to take a look at it. Benzo withdrawl symptoms can last a long time. And now they know benzo's can cause early onset dimentia. Weird how a little over a year ago my pdoc told me "it's such a good effective med". Now she's saying the opposite but it's the treatment for my rls. Other rls med has an ad in it which made me manic.
I really doubt pot is making you angry, you could stop for awhile to make sure though.