Well, I wouldn't give up. There are some decent woman who don't care as much for a guy's looks as for what kind of man he is.

However, that said, research shows that people do tend to match themselves up based on their level of physical attractiveness. You might not win over a movie star, but you don't have to only have relationships with really "ugly-looking" woman. Are looks all that important to you? I realize there needs to be a physical attraction, but sometimes people can "grow" on us.