What you write here seems pretty convincing that he is doing something he doesn't want you to know about, and it could likely be sexual. Of course, there are two sides to every story and we haven't heard his.