Is it possible to set up phone appointments or email your Doctor? Explain the situation he/she must realize that it's something you have no control over.
That is what I have been able to do if I can't deal with going or I need to get a hold of him.
warm thoughts