Doubt is the Mind Killer...

So, some background. Self-image issues since I am, by medical terms, morbidly obese. Wasn't really pushing to meet people till the last few years. A few months ago just ended my first ever relationship. Long distance for one year and living together for the other. We were each others first, both very inexperienced but he was all in, could see marriage in our future and I couldn't.
So I am back out there and a guy I met before my ex found me immediately contacted me. I was very flattered and trying to take it slow but he always brought the convo back to more physical topics. Our meet up was solely making out. Then messaging became kind of sparse, at least for me so I thought he ghosted me. Couldn't get him off my mind, especially physically, so I proposed casual sex. He was kind of huffy about it but I am hung up on him. We've met up a couple times since but I feel like I am going crazy.
Advice out there from the more experience?

What are you looking for in this relationship?

So far, he always brought the conversation to physical topics, and once you thought he had ghosted you, you offered casual sex. Plus, your first meet up was only for making out. If you only want this to be a friendly relationship for sex, than you are there.

If you want an emotional relationship, I don't think you will find it with a guy focused on physical topics, who only kept in closer contact with you after the offer of sex.

Be careful about seeing what you want to see, instead of what is.

Sounds like you entered into a physical not emotional relationship with the guy after your ex. Now that he's had a piece of you that he wanted seems he's ready to move on. In future relationships you'll have to decide at the start if you're looking for emotional or physical intimacy from the get go. Sometimes you can get both from the start, but not always.