The longer you stay with him, the harder it's going to be for you to break up with him. Resisting your doubts is going to become a habit and you're slowly going to become tolerant to worse behavior. At least, this is what I've often observed in my friends when their in difficult relationships.
To me, he sounds extremely immature. The early part of a relationship should be either great/exciting because you're so wild about each other, or neutral/pleasant and then improves as you slowly get to know/appreciate one another. But what you've described mainly just sounds negative. As other people have written, it's unlikely to get much better. Don't trick yourself by magnifying every decent, nice thing he does and then trying to minimize every mistake he makes.