In 1996 (27 years old) I had a pap test come back HSIL/CIN III (cancer insitu) at the time I was not sexually active, had not been sexually active since being abused as a young child, and my choice of partner would have been (and still is) female anyway. I ended up having a conization to remove cancerous cells (pathology came back positive), and then had to have a pap test every 3 months for a year, and then every 6 months for a year after that. I ended up having a hysterectomy at 32 due to endometriosis ( which can be found during the exam) and the fact that my pap test hit HSIL/CIN II that year, meaning the cancerous cells had returned...still no sexual activity with a male partner. There is much more involved with an anual exam, not just the pap test. All the pap test is, is a smear of cells that a lab looks at. While it is true that the test can give a false positive, a false positive is better, in my opinion, than no test and dying or never being able to have children because of falure to have the screening.
The most importnat thing to keep in mind is that the exam involves more than a pap smear...and more than HPV is looked for.