I do computer programming, and it requires more abstract thinking, learning the syntax and "grammar" of a language, and organization more than math.

I used to also think that I needed to have a job that required no interaction with people. It's simply not realistic, but it made me think about what was driving my desire to seek those kinds of jobs. It was because I was tired of people and tired of working in a field that made me unhappy.

Even though I'm in IT, my interaction with people is minimal to moderate depending on the work. To be honest-- I would rather interact with people outside of IT than people in it! My supervisor has no tact, a couple of my coworkers are not helpful, and everyone else seems to be clueless. Sometimes the grass really isn't greener on the other side.

Have you thought about finding out what you really want to do? It's not good to always focus on what you want to get away from. Focus on what you want to move toward and maybe that will help.