He's probably doing his cold shoulder on purpose. I would act like it didn't bother me. I think that you ending that relationship was the best thing for you. People who abuse any type of substance can be harmful for the other person. If it was me I would ask the boss to bar him from coming there. You will find somebody else.