Karmma, you are definitely not ungrateful as you recognise your husband's problems. However, you are a human with personal/social needs. I do feel your sadness that you cannot enjoy other activities with your husband.

Unfortunately, I cannot offer any suggestions other than not to give up. I know this may sound heavy but you should look after yourself and not accede to his wishes. Are there any groups you can join associated with existing hobbies or even new ones?

This situation is not confined to women, I know a few men who have lonely marriages because their wives are no longer interested in them and the shared/intimate activities they expected from their marriage. Whether there's a medical reason or not, it is so sad.