Hmm, you write you are a small female, I'm guessing you are young and attractive too. Some guys just act like jerks when they find women attractive - not that it should be excused, but that is likely the reason behind it. It's pathetic really.

As for how to handle it, well humour is good if you feel okay about that, sometimes a very polite mannered response can throw them off guard too. But mostly just keep yourself safe, you're smart you will know when there is possible danger.

Shrugging it off can be hard but I think if you give yourself credit for handling it, focus on what you did right (kept calm, got away etc) that might help.