hard to give advice cuz maybe you're right that he's an annoying dufus, but maybe it's your own state of mind or stress ... i did a similar thing in a relationship recently. and i may have ended it, not sure. but i'm pretty sure mine is an annoying dufus and that i'm doing the right thing :/