Most certainly it would look rather passive-aggressive if you don't eat at all. If these people treat you poorly just don't go. Have you ever confronted this obnoxious relative?