This is such a personal choice, I don't dare tell you yes or no. It is your and your husband's call.
Outweight the prons and cons and you'll find the answer.

gab