Are you stuck in your job, or stuck in your house? Sounds to me like the only reason you tolerate the job is because of the house. You're a single guy living alone, so you don't have to worry about schools, etc.

Dump the house. Buy something you can easily afford on $20k less income. Then dump the job. Your discretionary income should be essentially unchanged, so there wouldn't be much of a lifestyle change, but you'll be happier.