Unless it's reasonably fresh and still moist, sperm will not be active and capable of causing a pregnancy.
I would hope these guys are cleaning up after themselves! If not, invest in some Clorox wipes ASAP!