Maybe he needs mental help. He may be deflecting his low esteem off on you and making it sound like you are the problem when it is actually him.