You definitely sound angry to me and trying to say things that you know will hurt him. I don't think it's unprofessional to point that out and wonder why that is. Of course as the patient you get to call the shots, but you don't get to pretend that what you say has no consequences. How is that helpful? But as I said you're ultimately in charge; you certainly don't have to apologize to him if you don't want to.