You should be getting your full fifty minutes no matter what!! It’s ok to call him out on these things that you notice. Have you considered looking for another therapist? In my past I had therapists who I suspect did not like me. Changing therapists helped a great deal