I had a boyfriend once who would do that in his sleep. He didn't even remember doing it, but it drove me crazy. I never liked being touched while sleeping and I don't have abuse in my past. So I totally understand how you feel, though it must be much worse for someone with abuse in their history.

I would just kindly talk to him about it. Just say "babe....you were touching me while we were sleeeping, I don't know if you were awake or not, but it really bothers me and I had to say something." Just be nice about it, and let him know. I know men often have "erotic" dreams in the night, so he could have been sleeping. If he knows it bothers you and did it on purpose, then I would worry. But if he was asleep, he didn't even know he was doing it.