I grew up with parents who didn't want to be married to each other and it wasn't great. You can be a father without being a husband if that's what you need to do.

What's making you unhappy? Her insecurity and jealousy? If she resolved those problems, would it be okay?