I totally believe that the man has no recollection whatsoever of the situation; this is very common. One thing that you may do in an effort to prevent it from happening again is put a mountain of pillows between you so that he has to work to get to you. This might help a small % of the time, in theory the effort will "wake him up".