Direct is definitely necessary here. I think what you are tempted to say is great, minus the part about making plans with someone more important. Maybe say, "let me know a day and time that works, and stick to it." YOU are important.