It is fairly intimate to eat with another person. A guy can maintain boundaries by suggesting the other guy 'grabs something to eat' while they continue a discussion. Dinner suggests to me their boundaries are already lower. It suggests a coded message.