From what I have read you to say, if your question were mine, Plutonia, I would say that drinking as you are accustomed would not affect my recovery from drug addiction.
But, I would still be careful; I don't know how drinking fit in with the drug addiction; whether you drank when you could not get drugs or were with people who did not do drugs, for example, and just "convenient" rather than pleasurable and safe for you.
Insofar as alcohol lessens one's inhibitions and depresses one, those do not sound very safe for you (in that occasionally you do get drunk despite not liking/wanting to) as it might be easier to feel one could have an occasional line of cocaine, say, after a drink and be less inclined to refuse. You do not sound like you have accepted responsibility for your drinking, are "playing" with it.
That you can turn down drinks is not all there is to drinking; binge drinkers can do the same, not think about or want to drink between binges. Being "excited"

and curious about the taste of a "new" martini instead of, say, a fruit or vegetable you've never tried; I don't see very many lines in the sand that you have decided you do or do not want to cross nor enough "structure" to make me comfortable that not including drinking in with the other substances you use to abuse is a good idea at this time.
I recognize that my last sentence contradicts my first which is how I'm feeling about this :-) I'd be very very careful if you decide you wish to occasionally drink.