Your father is putting you, his young daughter, in the position of being his confidante. This is an inappropriate role for you.

You could consider telling your father that hearing his assessments of your brother make you uncomfortable and you wish that he would not share them with you.