Sounds a lot like my pdoc, and I can relate to being too nice and not wanting to confront him. Maybe someday, but I'll probably always be too nice, ha.
Anyway, good luck, and I hope you can find a much better doc soon!