Sorry to hear that you are suffering. When he comes down from this manic episode, he will likely shift into a deep depression. That's usually the best time to approach a bipolar person about getting help. They realize there's something really wrong and they just want to feel better.
You did the right thing giving him some space and making yourself safe. Try not to take his actions or lack thereof seriously right now. Of course accountability is always appropriate, but there's no point in confronting him until he is in his right mind and can feel normal emotions like sorrow for wrongdoing. What bipolar and even unipolar depressed people fail to recognize is that being on meds and in therapy is nothing like Cuckoo's Nest. Meds are mild compared to street drugs and very gradually dispensed and you won't be drooling unless you were wielding an axe or something and needed an injection. My morbid humor, sorry.
The psychiatrists and therapists these days aren't generally know-it-alls who pump you full of drugs and don't listen to your concerns. They will adjust them if you have a bad reaction and they want to work on whatever your goals are out of therapy. So...I don't know how to communicate this with him, but a good place to start is the Stephen Fry series where he (diagnosed bipolar in his later 30s or early 40s) talks to all kinds and ages of people with the disease, some of them quite famous and talented. It's done very sympathetically while showing how serious it is and needs to be treated.
This is part 1. I believe there are 12 parts of 9-10 each minutes in all and you may need to click about to find the correct next section, but most are numbered. It will help you understand him (if you've not already seen it) and maybe he'll see himself and realize how he's harming his own life and relationships without feeling threatened.