I don't think it's annoying necessarily....it probably just makes other people who don't regularly use those "therapy words" do a double-take.
I live in a crunchy hippy town, and people here use a lot of yoga terms and alternative medicine terms....it's not unusual to be in a casual conversation with a stranger about how "centered" they feel and how they need to "meditate on that" or go spend some time breathing.
For me, the therapy terms I've picked up are "being present" and I often find myself saying "I hear you" when someone is expressing themselves.