Perhaps the secret to a happy marriage is to have zero expectations? (Just a redundant question to ponder).

From my experience (not personal, but from friends and family) it's not too out there to leave and go back a few times.

I hope that writing here helps to solidify whatever decision you make for yourself. It has helped me tremendously to get another point of view.