I would take a step back from X. Cut off communication for six months, learn to be a father, and see where that takes you. Stay single for six months. You can be there for the mother of your child without having to be in a relationship right now (assuming she is okay with that).

I agree that the situation with X sounds like too much to handle. There's also a big danger that you guys are just rebounding with each other, looking for an excuse to leave your current unhappy relationship.