I'm amazed at your being able to quit the pornography addiction all on your own.

I don't know your age, but are you sure you want to take care of children ever again in your life?

I recommend that you enter couples counseling. Not for a brief session of it either, but the long haul--- you both appear to have issues (well, don't we all?) and you will have issues whether you are married to each other or another in the future. See if you can come together after all.

Are you people of faith at all? It might be good to seek counseling with the leader of your faith--or make it a time to strengthen that faith. Often when we take our eyes off ourselves and our own problems and look to God the new perspective gives us a good path to follow.