I don't think it's selfish of you at all to take time to reflect. For me, I know it's what I need. Sometimes, it's a lot of time. But that can't always happen unfortunately.

A lot of times I go to a friend's house that is close by, who is someone that I can just be myself around, before I go home. I don't do well at home when I am upset.

I don't think you should feel bad about taking time out to unwind or reflect after an appointment. I don't know many people who can open up emotional topics and then shut them off when they walk out of the room, and lots of times it takes a lot of thinking over issues and conversations in order to better understand them.