Hello nikkilondon: I see this is your first post here on PC. So... welcome to Psych Central.
I'm sorry you are encountering this difficulty with your boyfriend. You wrote you care deeply about him but the things he has said hurt you & you don't know what to do. It's just my personal opinion. But I doubt there is much of anything you can do. Your bf is, I believe, the only person who can change what he is doing.
You mentioned your bf's only taking his medication sporadically since he dislikes the side effects. But he won't do anything to try to address the situation. So, apparently, he's not in a place where he's willing to do what he needs to do to "get himself straight", so to speak. You can't change that. And until such time as your bf decides he is going to do what is necessary, it may be likely he's going to continue to respond to you in the same ways you have experienced so far.
All of the above being the case, the question then becomes, do you love this man enough to continue to tolerate his current treatment of you on the possibility that he'll take charge of himself at some point in the future & do what he needs to do to heal. Only you know the answer to that question.
Here are links to 8 articles, from Psych Central's archives, that (hopefully) may be of help with putting your situation into perspective & figuring out where to go from here:
You Can Only Change Yourself
How to Let Go When Your Partner Refuses to Change | Happily Imperfect
Learn the Subtle Signs of a Loved One's Verbal Abuse
Bipolar Disorder: Symptoms, Types & Treatments | Psych Central
Partner Diagnosed With Bipolar Disorder? 10 Truths You Need to Know
https://psychcentral.com/blog/8-ways...oved-one-cope/
https://psychcentral.com/blog/helpin...dium=popular17
https://psychcentral.com/blog/10-tip...ipolar-person/
I hope you find PC to be of benefit.