It isn't the drugs.

I have the same thing. And when I can not figure out where the hell I am - I panic.

Or I may know where I am, but just get this "sense" that I am lost even though I am not. And I panic.

Or (often) I can not remember where the hell I am going or how to get there - even if I have done it thousands of times. And I panic.