I have never worried about that. I view it as nobody's business but mine.
If people are close enough to me to know that I take medication then they are told what the medication is and what it is for.

Anyone who would choose to stay away from me only because I am bi-polar is not someone I want in my life.

Screw em' and find new friends who will accept you for the wonderful person that you are.