I don't think you've been permanently damaged; Effexor is a bear to withdrawl from, especially if your doctor made you go cold turkey, and the flu-like symptoms can last for weeks, or sometimes up to a couple of months.

You might consider looking for a "new" new doctor.