I have a cousin like this and for her it is an underlining fear of what he may tell her
Seeing a pdoc isnt always an easy thing to face
Like u said....just rmind yourself that you can always walk out that door if you want. You are not obligated
And maybe it is him...maybe there is just something you dont like about him or hes not a good fit
I hope someone else here can give you more assistance