I hate that medical practices/hospitals do that. They seem to assume that everyone has a crowd of family and friends standing at the ready to help the person out, or that everyone has the funds to hire a driver.
Yes, I would speak with your doctor or a nurse you trust and explain the situation.