I would go, as Echoes says, and then only eat a bite or two, play with your food :-) and then get a box to take it home. I'd use it as an experiment to check out my fears.

Do you know where he wants to go tonight? Maybe you can maneuver to a less formal place or place with lots to "see" so your eating doesn't feel so prime-time?