I can relate, too. I'm not sure what it is... maybe anxiety that there are so many things to do, I get overwhelmed. It makes me very distractable.
Sometimes it helps me to listen to a radio drama or book on tape (as long as the thing I have to do isn't word-oriented), or music.