In the NHS they say "service users". Mine says "people I work with". But personally I wouldn't be offended by either "patient" or "client". I think the intention behind the words, or the way they are said, matters most to me. E.g. someone could probably manage to give a patronising delivery to any of these names. Or a kind and caring tone. Etc.