If coworkers and your boss are going to do that on birthdays, it needs to be done for everyone. That is plain not nice. But don't take it personally. It's their problem.
Next birthday, bring in a giant cake for yourself and take a long lunch. That should make a nice point.