I understand that it's not just the sex, but "normally" this type of activity leads to sex and since he's having trouble in that area he may be trying to avoid it entirely.

What is it that is stressing you out? Why are you snapping? I ask because I am this way and it turns out that this is an aspect of OCD, which there is medication to help manage.