Maybe time to find another Gym if these annoying people are bothering you. Aggravating people live on all the continents of the world. There is life after footy.... there is cricket.

Sorry couldn't restrain myself.
Personally I have never been to a footy match and watching cricket is about as exciting as watching paint dry. Socially people who talk incessantly make me tune out. Are we supposed to be that competitive? Me thinks not.
Maybe time to seek out friends that have interests more a tune to yours.