You'll need to be very clear with him that at all cost to please not contact you again. This will become a complicated situation and everyone needs the time to move on. I wish you the best.