Depressedgirl,
I can see where you're coming from when you say it's "nice that he only pushes you", but as others have suggested, these things can escalate. Using what you've told us, it's already escalated from pushing to pressing into your neck. Maybe next time he'll have his hands round your neck!

Don't let this go on, even if it is better than past relationships, it's still not acceptable for him to treat you in this way. I'd suggest that, together, you find mechanisms which stop his temper getting so bad. I'm not suggest you give in, but maybe anger management would help. Maybe you two should agree on a system or something where, when he's approaching boiling point, you both agree to stop the conversation dead. Then he MUST take a walk around the block or something to cool down.

Best of luck. I'm sure you and he can find some coping mechanisms together, but please don't let this go on.