Interesting how you see others and humanity as growing. I wish I had that positive outlook. Do you really think most people are growing? You might live in a wealthy town, or you might be surrounded by highly intelligent people. I live in the average American town, so I see nothing good here.
I see humanity and others as decaying, or falling apart. All of my high school friends are married with kids. Do I think they've grown? Not really. They are unhappily married, physically unhealthy, and look 20 years older than me. I'm glad I'm not in their shoes.
If a friend leaves you because you are not growing, then he was never was your friend. If you think you're not growing, that's not such a bad thing. When you meet lots of people who've "grown" you realize they're not so great afterall.