I do know some fear the government is spying on them.
However, I think of it this way. The government does not have unlimited funds to spend. Can you imagine how much it would cost to have FBI agents tracking every person in the US? It's just not feasible.
So you could say they are only tracking a few. Well honestly, I don't think I'm special enough to interest the government. I can't see anything about my life that would raise an eyebrow. So I don't worry about it myself.