It sounds like he's taking advantage of you.

AND setting a bad example for your kids. Your kids are going to learn that it's ok for a guy to have secret female friends and lie to his partner.

Get out for your sake. Get out for their sake. You all deserve better!