fighting is never the answer to anything. fighting causes more fighting.
Communication is the key to any relationship. Let him know how it makes you feel.