I have issues with irritation from shaving.
I think you hit it right on the head. The best thing to do
is let your beard grow out for a few days.
By shaving less often you won't experience nearly as much
irritation. If you are working this may not be an option but
if not try shaving every three days or so, it really helps.