You work with him, so you have to see him. Be careful. Try to put the relationship back to cordial co-employee. His aggressiveness of criticizing you for not being as he thought you should be (on the first date) was concerning regardless of any diagnosis. He could potentially be dangerous.