You did do the right thing. I have relatives that when certain subjects come up I have to walk away. I know I will never change their mind and it isn't worth the effort.

I don't even think that it should have been embarrassing for you, you avoided an argument and that is good. You are certainly not stupid, I would say rather smart to do what you did.
Way to go.