Two words - good riddance.

Don't dwell on what he said about your ladyparts. Not related to reality at all. Not whatsoever. What happened was that you asked him to leave, but with his ego he could not take being rejected, so he pulled a sour grapes line on you. That is all.