There is my rule: If you have to ask yourself "should I do it or no?" Or in your case "should I stay?" The answer is NO because when we ask ourself this questions, we are really looking for a reason to do it. In side of us, we know that something is just not right for one reason or another. Knowing that we should not do it or wait for something better to come. If we really wanted to do what we are asking, we or most people would not ask but just do it.
I think you know the answer to your question. But you don't know what will happen next and that is what is really getting to you right now.
Hope things work out for you. Good Luck!