Yes, absolutely, unless you get one of those that zips down the front. I just got a new pull-on sports bra from Hanes and you should just see me trying to pull it on and off. I nearly throttled myself in it yesterday.
I'm going to try a new approach next time: pulling the body of it over my head, then trying to clear the straps. We'll see how that works.... LOL