"no, I'll be sleeping in that day. I need the sleep. Maybe you could take an Uber?"
I know what you're going through here. I've had very similar people in my life.