marycarmen, it sounds like you were together from such a young age and neither of you had a chance to know other people or explore your lives as an independent person. You ended up growing apart. He had affairs not because you were not good enough, but he somehow needed to have a sense of personal freedom, that was IN HIM and really was not about you or you not being good enough etc.
You probably do have some good memories with him, you were close too. Yet, you both were also young and as time passed you grew apart and he lost interest in being a grown up with responsiblities and did not want to work and be an adult. He missed earlier years of just being single and exploring so he developed a void you could not fix or fill. He simply got lost and resentful and probably depressed.
How old were the two of you when things went down hill?