It also depends on the length of time you've been on a benzo. It doesn't take that long to hit tolerance and start having interdose withdrawals.

If you're not taking Xanax on a regular basis, then you're smart and at least you won't have to worry about that.