I do this all the time.

I tend to split people up in to 3 categories

- people who I want to spend time with

- people who I don't really want to spend time with, but do it because I want to be polite

and then people who I really don't want to be with, even out of politeness