It sounds like he's the one that's been wanting to break up for ages and is just looking for a reason to do it to make himself feel better and put the blame on you. It really sounds like you can easily do much better.

Sorry he's pulling such a stunt, especially around your birthday. I hope you can enjoy your day at least a little bit.