It sounds like they mean well and they like your company, I think Maven's suggestion of declining politely but firmly is the way to go.

I would make a joke of it (I often make kight of my own introversion), but leave them in no doubt you are busy/have other plans and will catch up with them when you can. It's absolutely valid to need time to recharge etc.