choosing not to pursue or try with someone for reasons such as "he/she is too good for me" is entirely the wrong reason to make a decision. But then it's a matter of perspective, and your own self worth that comes into play here. Something that probably won't change by any amount of people telling you that you shouldn't think that way.

but I will say this. In matters of love, do you honestly think that relationships are built based on people deserving each other? This seems to be a performance based idealogy as if someone should not be with someone else if they are not at some abstract and unrealistic ideal of goodness. Which is not true. Rarely do we actually fall for people that we are perfectly equal to or deserve and vice versa.

No one is all good nor all bad.

I fear that you might be idolizing this person too much though and that's worth considering. Why do you think he's so much more valuable than you?