I am sorry you are not getting what you need from your husband.

it sounds tough on you
Saying that, if my husband went to “cuddle meet up” and wanted to cuddle strangers I’d have hard time with it. Likely I’d say worse things that your husband said and they would not be under my breath. Frankly I’d not tolerate that. It would be a deal breaker
Well the difference is I don’t neglect my husband (the way he appears to neglect you)!and he isn’t miserable. Now, I personally don’t think you can substitute lack of loving relationship at home with cuddling strangers.
Have you considered marital therapy or perhaps leaving him all together?