I didn't notice a manic phase until recently, and I've had this diagnosis for over ten years...
Plus ADHD can be a differential diagnosis, so some of the symptoms are similar.
The depression is easy to notice, the mania not so much. And like everyone else has pointed out, it's not always happy, irritability is also a part of it.
The more I educated myself, the better I was able to understand my diagnosis.