My advice would be to stay in public places and not go to his house or your house. When I go someplace private, sometimes I end up having sex even if I don't want to and it's not right.

Also, wondering how long you have been seeing this guy. And have you tried a support group for sex addicts? I've heard they can help.