I'm sorry you've felt this way. Unfortunately, the privacy act really only protects the doctors and not us. Once we sign that, we give them permission to discuss us, share info with anyone they feel good about doing so with (

?) When the attorneys in my case, both mine and the opposition, gained access to my private medical records, they are no longer under the privacy clause/act... and not liable if the information goes further. So it isn't illegal to share info about you, if you have signed a privacy permission slip.
However, that doesn't mean it isn't unethical. It is in some cases. There has "always" been a "confidentiality" agreement between professionals who have need to discuss patients with others for the benefit of patients or for their own safety. It's a gentleman's agreement that "I" (as if a doctor) won't discuss the information that "you" (as if a doctor) give me about a patient, but we agree to keep the information between us. When I was first injured, there was a whole team meeting weekly to discuss me and other patients they had in common... it was the BEST treatment I ever received! (Mangled care ruined that though.)
Please discuss the situation with the doctor involved. Let him know how you feel about it, and work through this. It might be you can cause the doctor to be careful in the future, thus preventing a lot of problems for you, and others?
TC