what about rolling them up a bit before going to wash them.....
like not just pushing back, and not excessive big roles but just a few little ones,. Usually with most of my sweaters the cuff for the wrist is smaller than my forearm (course I am not skinny either so that may be helpful with this

)......
Not sure if that is helpful or not, but an idea.