I don't think I would be comfortable with it, but that's mostly because it's yoga. I would go to, say, a painting class if I knew my T would be there.
Can you picture yourself if the yoga class with T there? Would you be able to focus on the yoga and relax, or would you be more worried about what your T was doing or thinking about you?