If you refuse a shelter and cannot go back where you were before, then I'm out of ideas.

You can put yourself in the mindframe that you are the housekeeper there (which it seems you are) and treat it as a business relationship. If he isn't encouraging a relationship with you, there's no payoff to having feelings for him and they will go away.