It depends on the lager context. One could suggest continuing to shop while she was busy in the restroom is passive aggressive too.

I don't think you were. Most likely you just didn't want to waste time in the store sitting around right?

Gotta give them a break unless there's a pattern. Look for patterns of this kind of behavior. One instance is not enough to conclude anything.