You are ending them for a reason. No need to waste your time if you know it’s not what you need.

It’s easy for him to say that his choices shouldn’t effect you.

Well if he is under influence after 5pm (or whatever time he starts) and is unable to drive somewhere in case of emergency, cannot attend important events, cannot be available for whatever situations might occur, then sure it effects the other person! And not in a good way.