Yes, it's happened to me. It doesn't help that I have actual physical pain in the area due to a disease. So for me it happens both as you describe and the reverse - the actual physical pain triggers memories. I can only tell them apart by which comes first.

Still, I might, just to be sure, mention it to your gynecologist at your next visit since they're a specialist.