Sounds like he doesn't care about you and the new baby.
I say - make plans for yourself and your child, and take care of yourself.