I would find someone, books, something to help me learn how to deal with such situations and idiots? For right now, I would try to change my perspective (since you see what is happening) to one of amusement (can't get me because I know what you are doing!) and see if you can better recognize how well you do understand and how well you do handle the situation and add a "here it is again, sigh" piece of armor to your repetoire right away.

You don't have to like the guy/these idiots. As you say, they are everywhere. Take care of yourself (know who you are and what you are there for for yourself (money so you can live better than without money :-) and look around for some not quite so horrible guys to listen to and practice interacting with; with "nice" people you can talk to more naturally and who don't feel like they are out to get you, it is possible to share the what-should-I-do-with-this-guy? He probably does not just get under your skin, but other people's too; observing people (instead of hiding) can teach you a lot and make you feel better, since we all have our obnoxious types.