It happened when I was younger, often it was people trying to 'bring me out of my shell' which is quite insulting as I was happy as I was.

I never did find a good way to respond, but when it's in your job and it's a customer or colleague it's doubly awkward, you have to let a lot go.