It sounds like you guys have made progress... a bit at least?

Maybe next time, if he does say no again, you could ask him just to hold you for a while or something, just to make you feel a bit better about life in general? That way you'd get something for the emotional closeness at least, and it sounds like that's just as important to you as the actual sex.