I get summoned that way all of the time, and i'm almost always just as annoyed. I think i've summarized it (for me at least) feeling like there is no consideration that I may be doing anything with my life (whether I am or not) except anxiously waiting for the person who needs me to request my presence/services. It just gets old. I think they were consumed with that "in the moment anxiety" about the door, and i'm not exactly sure why a simple whole hearted apology could not be offered - thus, I think you had the right to be slightly annoyed.