I think it just depends on the type of job too. I've gone through MANY different types of jobs. Cashier, retail, catering, sales, graphic design. I finally settled into a job that makes it as easy for me function as possible.

1) It's typically quiet and I can sit in my cubicle with my head phones and not really interact with anyone if I'm not feeling up to it.
2) It's literally a 30 second drive from my house. (I COULD walk... but I don't... of course.) Long commutes give me some wicked road rage.
3) We get liberal breaks throughout the day and a very flexible lunch break.
4) My boss is amazing and doesn't do the "micro managing" thing and literally will only bother me once a week (if that) and it's literally for only a few minutes.
5) I don't have to sit in many meetings (three a week... that's it. Although there are always two on Mondays, so Mondays are usually about as bad as it can get. But the department is a lot of younger people in their late 20s, early 30s so many of the meetings are just BSing a lot of the time.)
6) Oh! And I don't ever have to talk on the phone! Big plus for me!

It took me a LONG time to find a job like that. And literally, for me, I need EVERY aspect of the things I listed above. Yes, I realize this makes me sound needy, but I simply couldn't function if it were any other way. (I've tried! It hasn't worked!) And some days, I have a hard enough time functioning even under perfectly ideal conditions. Every one is different and there probably IS a job out there for everyone. But finding it is like finding a literal needle in a haystack and sometimes you simply have to luck your way into it.