Does he really interfere with the goals you have set for yourself for the coming 4 years? If not, I would probably try to adjust to the situation as good as possible because you will always meet people in life who will annoy you. You can't change that, you can only change the way you handle it.