I think it was VERY wrong of him to say you could call him day or night if you felt like SIing. That puts both of you in a bad situation.

Maybe you could work out something different like using a hotline?