I think I probably would not go back. He may know what he is doing, but he should care enough about clients to present a different atmosphere. How are you supposed to feel comfortable enough to do therapy there?

That you don't fit the classic EMDR profile and your therapist agrees suggests you don't need this guy. Can your therapist find you someone else with a different approach if that's what you need?