I say no, stay away. With all the yes-no yes-no confusion between you, the likelihood you'll miss a yes-yes relationship grows. It sounds like there's some attraction between you, coupled with mind games all round, and from experience, it won't end up in a long term thing that keeps the both of you happy.