I've had that issue before and it pretty much ruined my relationship.

I don't know any way to get past it than to just split up and try again.