Did he break up with you or the other way around?
Sounds like he wants to have his cake and eat it too...Don't give in to his manipulations and emotional blackmail (my opinion).
If he wanted you back REALLY then he wouldn't be with another girl.
Try cutting communication with him if you feel that you can.
Best of luck xx