Not to rain on anything, but one thing I'm wondering is if he may have just wanted to eat lunch together, non-romantically, and maybe you misunderstood, since you have feelings for him.

However, if he did mean it romantically, that's highly unethical of him and unprofessional. It's not worth it in my opinion.