Imo, there's a difference between not wanting to date someone because you are genuinely concerned your differences in lifestyle or education level might present problems in the relationship and not wanting to date someone because you feel they are beneath you.

It's like the difference between a guy not wanting to date a woman because he isn't attracted to her and a guy being attracted to a woman yet not wanting to date her because she isn't conventionally attractive enough to be his trophy girlfriend.