Keep records. Write down everything said, with the dates, who was there. Keep good clear evidence of these incidents.

If you have a good union they should support you as you are the victims of his unreasonable behaviour.