Driving Uber or taxi is a common job among immigrants. They don’t really have to converse much. As long as they understand directions, they usually are fine. I don’t think it’s the kind of job where you need to meet language requirements. I don’t see how imposing that language mastery demand would work. Random people drive Uber.

I think you just had a bad luck with mutual misunderstanding