If he mistreats his own daughter and now your kids are saying this - I think you should believe your children and pay attention to the signs in front of you. His own daughter is a red flag. I don't fall for "it's just a joke" - if the receiver of this joke isn't laughing, then it's not a joke....it's a cover up. If I was in your shoes I would leave this man.