The constitution doesn't say "freedom FROM religion"; it says freedom OF religion.

This country was founded by people who had been persecuted for believing what they did. In their wisdom, our forefathers put it down to posterity that they and their decendants could be free to choose what they wanted to believe in.

When someone has been given a freedom, we don't want to loose it. I'm sure you wouldn't want to, either.