Humans hit each other. They are animals, and that is part of the way animals communicate. Society has blown the hitting issue way out proportion.

Edit: If he does it often or with a clear intent to actually inure you then you have a problem, and should leave him immediately, but that doesn't sound like the case in this situation.