What you describe is identical to my own experience. I found that volunteering one morning a week paid off huge dividends. I was extremely nervous at the beginning but now look forward to those days and would not miss them for anything.
Don't beat yourself up over the PJ days. They are an occasional reality. Try and make pace with them and don't listen to people who think their lives are validated because they are always 'so busy'.
Best wishes