Perhaps your doctor could offer a phone appointment at bare minimum. It's not a perfect solution but it's better than nothing.