I'd say boo! to the lot of them. This day is totally about you and your husband to be - invite those who will help your day to be a very happy one.
Some may get in a huff, but give them the contact details of their nearest T so they can work through THEIR feelings about not being invited - hey they may even have the chance to reflect and gain some insight
Seriously, I do think we can tie ourselves up in knotts trying to consider everyone else, this day is the start of your life together as a new family. Let the others think what they want to think. Soup