I can't speak for John Lennon, but I always took that line to mean "What if the things that divide us were no more?" (religion and politics can divide. Organized religion does not equal god, IMHO)