You are right to leave. He sounds passive agressive. I'd go for emotionally supportive people in your life. Trying to figure this man out is a waste of time. What he said would probably baffle anyone because what he said wasn't logical and it was hurtful.