It sounds like you've told him it's over, but he won't listen. It might be better to cut off contact outside of when you have to see each other at work.