Yes, you should distance yourself from him, because his ignorance is militant.

When ignorance becomes militant, the best move is to distance yourself. Militant ignorance differs from regular, innocent ignorance, and you are dealing with a case of militant ignorance.

I am sorry you were triggered and hope that you can get better friends. The best way to cope with people who are militantly ignorant is by stopping to relate to them.