It sounds like you have some things to work out within yourself. I'd do that before taking the next step. He's still there, which is a good sign. Pressuring him may change that. Good luck!