Have you asked him why he doesn't want to have sex as frequent as you expect him to?