I would think about asking him what mood he thinks you are in next time you see him. It's not clear to me that he was disagreeing with what you said rather than having a belief that people with bipolar cannot truly judge their own mood.