Sounds like you need to choose to be content with your own work and progress and not worry so much about him. There will always be people we work with that we wish we didn't have to work with, but we really just have to choose to work our own job and let them work theirs.