Maybe try strictly limiting yourself to the recommended portions, rather than to nothing at all? It would still provide some limitation so maybe that would help?