I know you've said he's a sports psychologist in the main, but what is his modality? I can understand that his feelings still matter, but he's worked with you for long enough to know that you'd be sensitive to that kind of thing, surely? The constant threat of in-person being 'taken away' must be detrimental to your progress with therapy, if only in terms of your level of comfort in working with him.