Speaking as someone in recovery...if you are uncomfortable with the drinking you have to say something. It can start off as a drink here and there and escalate or at least bother you enough that you snap. You have a right to enjoy him sober.