This may sound bad. But maybe he was molesting you while you slept. Some thing to look into. Ever had this happen to you away from him when you were truly alone??