I think seek out a professional for yourself, if not for you both. A professional may want to see you, and him at different times. I'd guess you can not read his mind. I hope others jump in here with better ideas and experience. I hope things get better for you both.