Start looking for a new place to live. You are not here to dance to his tune.

You are right in that he is behaving *very* selfishly. He is not considering you nor your feelings as his partner and he is not communicating. It is all on his terms. Is this how the relationship will proceed from now on: he leaves when he can't hack it, comes back when he can, rinse and repeat? This is not acceptable.

So look out for yourself and don't let his dictate conditions for this relationship, where *he* decides what is best for the relationship.