You're not getting any younger, for sure. Time's Arrow was fiction. You're remaining at a previous state, and as your chronological age progresses, the previous state is relatively more and more distant. Your reference frame is moving, like if a car creeps forward at a stoplight and you feel you're rolling backwards. Since everyone else is progressing, as you point out, relative to you, this seems to explain things quite economically.