Can you socialize on your own terms? What if it was to be you who were to organize the dinner parties and outings. This would give you the opportunity to choose locations (or even your own home) that are easier for you to manage.

There is nothing wrong with establishing boundaries by the way - even when these boundaries are over things like food.

The next time you find yourself invited to something that entails food, politely decline and offer a suggestion for what to do next time.