I think they should be able to speak whatever language they are comfortable using, if they are just speaking to each other. It is not rude in the least.