The only person who seems like less of a man was your father. Had he been a real man he wouldn't have treated you ( his son) the way he did. And perhaps he did have issues with his own masculinity? He found you as a child an easy target to make himself feel better.