its his fault, i think you should talk to your advisor but try not to be like rude about it or anything; but just talk to your advisor about your concerns in a respectful way and hopefully your advisor could have a conversation with your co-worker about prioritizing and being professional. Best of Luck!