He had no need to tell you how everyone was telling him that they thought you were back together and that it bothered him. Did he not think that would happen in inviting you to hang out with them?

Sounds like a crappy experience. It sounds shame inducing. A complete set up for failure and embarrassment.

Do you have a set of friends that can help you move on from him?