I think you would have to answer that for yourself, what you wanted, how you wanted to feel and how it affects you. I know that smoking and drinking can be related; doing one elicits doing the other, don't know your patterns and whether you would be tempted to go back to the drugs by allowing yourself an occasional drink.

If you do not like alcohol, that sets off a tiny alarm to me; you seem to accept "any" alcohol too? That seems a bit like you aren't paying attention, aren't drinking with "intent". If I were offered a martini or nothing, I'd take the nothing as I am primarily a beer drinker and don't like martinis. But I'd be thinking about it and paying attention to what I wanted, not just going along with whatever is happening, like it sounds like you are?

I would see if I could drink ice tea or lemonade, soda, etc. when I am with drinkers, see how that feels. If it is "uncomfortable", if I'd rather have the beer, martini, whatever, feel like I don't "fit in" or aren't being "sociable", I'd evaluate what seems a good idea for me to do based on my experience and desires for myself.