It's less concerning whether he'd be offended at being told to stop touching you constantly in a sexual nature, than the fact that you are expressing discomfort.

Boundaries!!