Hmmm. Maybe they are offended because you are listening to music but they know you are still hearing them. If you aren't going to add to the conversation, then the best thing is to move away from the rest of them. Could you possibly say something like, "I'm going over hear to listen to some music. If you need me to do something, then just tap me on the shoulder."

Are you able to actually communicate with the rest of them? They might not be talking to you because you aren't talking to them.