Based on the info given, I would change my phone number. Engaging with him at all sounds unhealthy for you and him.