If you feel uncomfortable with him constantly touching, you should speak up. Why would your husband get offended?