Honestly, I hate sex. But more power to ya if you enjoy it.

Anyways...you deserve to be happy and if casual sex isn't something that you're happy with then I'd lose the guy, and work towards something more meaningful with someone else.