Have you told him that the friends with benefits is stopping? Just be upfront and honest. It's not working for you and you have very right to decide no more sexual relations with him.