It is rude in other parts of the world but it is not considered rude in the us. They don't mean harm either. They are just trying to break the ice. The problem is there are a lot of disability haters so it is probably best to feel them out before you tell them.

How about...
I am on sabbatical from career as a "". What do you do for fun?

That should remove the subject altogether.