It does sound like you could be allergic to the fillers or dye like Wild Coyote. In the US at least you could have your meds filled at a compounding pharmacy where they could use different inactive ingredients than normal. As for not wanting to see an allergist, as RxQueen 875 pointed out, that could be dangerous--and certainly important enough for you to overcome your dislike of doctors.