The best way I found to deal with this problem when my husband was acting the same way was to make sure that I did not take it personally and to never actually ask him for sex, but rather just do (initiate sex through touching him) - this method left me happy and us having a great sexual encounter together 99% of the time.