For me the key to getting back to the relationship is to make absolutely positively sure that he has heard and understood why you are bothered. You have every right to expect him to be responsive to it.

While he may view his staff as an extension of himself, you do not. Nor should you. His response that he will fire the person if they violate confidentiality, to me, indicates that he still may not understand how you see it.