I usually just respond "because I can" in a stern voice. If they keep bugging me, I proceed to say "if you have a problem with it than leave me the hell alone".

Thankfully, most people get the hint after the first part because I apparently have quite the ability to become intimidating when I want to or need to be lol.