If a Med is causing difficulties breathing then you need off it.
I quit cold turkey and it was hell, I lost days, feeling cold and burning up.
Normally I would say wait to do a taper.
Could your breathing problems be part of akathesia ?? It’s horrible a panic / anxiety inducing which in me cause big breathing issues
Call you call your Pdoc ?? Yep it’s Friday of course , but he/she might call you in a script for Cogentin which can help with the akathesia bit
Hope you find some relief sooner rather than later.