Oh dear, this sounds so difficult

is there anyone in real life you could ask to help you be not left alone with him? Anyone who could champion for you or stay with you? Also, writing a diary of your interactions with him may be a good idea in case you need help from someone official, to show that your feelings aren't without reason. I really wish I could help more