I get it. I have one son, soon to be five and would love to have a second. But, I know with a bad marriage, anxiety issues, and money never really being great, equals....bad idea.

For me I believe that there is a reason for everything and I have chosen to not have the second, but do so much for my only one! In the end I think it's better for everyone, including my son.
If you still feel you want to have a baby, why not make a one year plan and see where you are then. Who knows, that could be the perfect time for you!