i agree with all said above,
Maybe some counselling would help you, or something else that boosts your self esteem, because your relationship isnt the problem. Its how you feel about yourself that is.
i know its hard but you have to break the cycle.