You have a say in your life.
You have a say in the type of people you choose to engage with, a say in when you choose to engage and if you choose to engage.

Don't go.

Husband might be mad, inlaws may be offended, kids may be dissapointed (at first, they get over it when a good time is involved)

And you know what? that's perfectly ok (unless your husband beats you, then I digress)

Fact is, the sky won't fall if you go against the grain, and best of all, you will be safe and happy