Maybe try just sleeping an hour or two later instead of till noon and see if that makes any changes... I honestly don't know, but maybe you do end up with too much sleep on those days, but still aren't getting quite enough on the days you only get the four hours!