Only you can answer this question. If you only want him for sex then of course you won't be happy. But if you care about him and he cares about you and you love each other then yes, you can be happy without it. Personally, I think sex is overrated and I could quite easily survive without it. But, like I said, only you can answer this question.