I think finding out more about him is a good idea. I wouldn't let the fact that he is the mailman stop me. I never see my mailman, so avoiding him would be pretty easy.