I'm not in the same exact boat because it's not a real relationship thing, but I don't handle it well at all. It makes me talk to him more and more about it until he gets to the point where he gets so annoyed with me and it was worse than the first place.

I'm really sorry about your situation. I would say an affair is not exactly the best way to go about it because it can leave a devistating mark on so many people. I don't know about the divorce option because I don't know the details of your life around it. Maybe if you feel that's the way to go, you could stay with a friend or a family member and et a job until you can support yourself all on your own or something.