No way. Shop where you're most comfortable. I would do the same to avoid coworkers. It's your money to use however you want to. You're already working for them so don't let them guilt you into spending your money or spending more time in your workplace than is necessary. That's not your obligation.