Hi Tilly May ~ My ex used to do that to me too.

I couldn't get just a hug. I had to get groped all the time -- and if I said something about it, it made him MAD.
All I wanted was just a hug, not to be groped/fondled all the time. He'd do that when I was cooking/cleaning/you name it! It drove me nuts! I didn't see that as "affection." Especially since the rest of the time, he was emotionally abusive.
I just told him I didn't want to be groped, I'd rather have hugs. Whatever he did with that information was his business. (he got mad and didn't touch me after that) LOL