It sounds like the doctor is mean-spirited and manipulative. He does not have the right temperament to be practicing medicine imo. He should be reported. I hope your other co-workers know your character and that you would not say or do anything negative like he claims.