Sorry if I misunderstood, but it sounds like he's merely saying he's attracted to you, not that he would in any shape or form have a relationship with you. Sure, he's being honest with you that he is attracted to you, but I think the only reason he said that was to help you with your self-esteem. If I was in your situation I would definitely stay with him. If there was even the slightest thought that you think he would have a relationship with you, then I think you should ask him. I think he's trying to help you. Wishing you the best!