Well, only you know him irl so if you see that sex is all he wants then you're right. As for being jealous that comes with it too. Regardless of being in a romantic relationship and putting a name to it or not that's how it is. Some people disagree but when sex is involved feelings are too. Even though he isn't acknowledging it, that's exactly what's going on.