It is for the best for the both of you to reach a mutual agreement. It might not be the time yet waiting a few more days or even months is not that long. He is not just thinking about himself or just for the both of you but instead for your whole family together with the child that you want.