If you want to rationalize following your attorney's advice, think about the advantages you already gave your wife by giving up your right to spousal support and by not insisting that the house be in both of your names. This is enough. Get a refund if your contribution and walk away with it. This will not be breaking the promise, especially if you were in a dumb state of mind and not advised by an independent attorney when you made the promise.