You reaction was OTT. Refusing to leave his office, he could have called security and had you thrown out of the premises.