The best thing you can do for your self esteem is get away from the person destroying it. Building up your self esteem so you can handle the criticism doesn't feel right to me. You deserve someone who builds you up, not tears you down.