You know yourself better than the doctor thinks he does. I would try finding another one. After all, you're the one paying him (well through some type of insurance anyway), so you deserve to get what you pay for.
I'm trying to give this recent med adjustment another two weeks before my distrust for him goes completely out the window and I'm on the hunt for a new doc..