People are people. People who are disabled realize they have a disability (my guess is they have seen the stares before). There's no need to go out of your way to interact OR avoid.
You're in the way of someone who is using a wheelchair; they say 'excuse me'.
You're in the way of someone who doesn't have a visible disability; they say 'excuse me'. Same situation, same response.