I think there need to be some sort of parameters discussed. You two did have a relationship which ended, and it may not be very clear to him what he is / isn't meant to do. I'm assuming you two are not "exclusive" ? Are you?

I think it's difficult because there's the main underlying issue of insecurity, and I'm not sure how that would be resolved if you two are currently not in an exclusive partnership with one another?