Okay. Naturally, it turned out to be someone I knew. They showed up when I had just stepped out briefly. There was no doorbell and knocking didn't work well, so they poked their head in to call out hello. When they realized I wasn't there, they left the book just inside the door so it wouldn't get ruined by the elements.

Leaving out details, or making up stuff, sounds way better.