Amanda,
Lynn's advice was spot on...
I'm glad your husband will be there with you...if necessary, he can take over if you absolutely have to leave.
My thought about your pdoc making that statement is yes, it is going to impact you but it does not have to be a setback. Perhaps as Lynn suggested, it can bring you a bit of strength and power...

Best wishes,
Catherine