So sorry. Instead of doing something self-destructive, I think I'd call him back and tell him what you said about your living arrangements. If he's ugly about it, then it sounds like you need to find a nearer church, at least until he leaves. Shame on him. (I'm a pastor's wife.)

And seek other sources of help.

Let us know how it goes.