Maybe you are just on the wrong meds for you and there are others that will help you with your symptoms more effectively. Tell your pdoc about the negative impact they are having on you and they can help you taper off them and perhaps offer a med that suits you. It can really take quite a few tries to get the right meds so don't give up on them entirely. I could be wrong but I sense that you would be worse, or at least no better, without any medication.

Taking medication is your decision in the end but it is better to make that decision when stable.