Definitely point out that they are being rude. Don't bother with the scientific arguments or any conversation about your diet. It isn't any of their business what you do and don't eat, whatever that happens to be. Keep the focus on their incredibly boorish behavior.

If someone tries to 'convert' me, I remind them that I'm not shoving my views down their throat, and I expect them to do the same.