To me (I'm a guy) these are mixed signals. If he wants something more and you don't then stop texting him or tell him you don't consider him as a man but as a pushover. As harsh as it sounds, it seems like thats your reality here.