Agreed that you need to talk to him about it. Does he allow out-of-session contact like e-mail or texts? That could help you get through. Or could you see him once a week?