I would file a harassment report against him and place cameras around your property. If something does happen hopefully with two things in place you will be justified and have proof of your right to defend yourself and doing so.