You can look at telling him what's going on, and your concerns about his well being, may be opening new levels of intimacy between the the two of you. Maybe he would be happy to just be with you when you have a bad day and are not feeling very frisky and it could make him feel good about it. Men don't look only for sex. Being needed, knowing he is someone you trust and feel you can depend on, is pretty powerful stuff. And who knows "just cuddling" can lead to something more.