He is his own person. Maybe he senses you want him to be different and he is trying to protect himself? I know patience is hard but you can pretend patience. Slapping a child like that, there are simply no excuses. If you cannot control your own anger, how will he ever be able to control his? He is just a child with a still non developed frontal cortex. You, have one.