I have the same problem. Everytime I go out someone "discovers" something I didn't do. Not that these things aren't done mind you, but because I can't immediately defend myself it becomes a thing.

That being said, last year a co worker was getting thin, we all noticed it. She couldn't take time off though because of a legit important thing. When it was over she finally did... uterine cancer... she was dead within 2 weeks of the diagnosis. Take the time off for your health.