It's a silly thing to say. Of course you should worry about what people think; people are a huge part of life. If you are hypomanic are you on some kind of drug to help ease it? Also therapy, even if it is just your default mode.