There have been times when I wanted to do something (or felt I should) with a very messy family and my therapist felt it was dangerous at worst and overwhelming at the least. My experience is that he was usually right. He often gave me an out, telling me to blame him for telling me I wasn't well enough to do whatever when I felt obligated to attend. My experience has been that he's been right and I shouldn't have gone. I know it's harder with a new therapist but if your pdoc feels you shouldn't go perhaps that is a sign it would have been a bad idea?