Try not to blame yourself. I don't think this is about you. It sounds like he wandered and is infatuated with someone else. If you don't like feeling like a victim, decide what you can do for yourself. Is there a class you're interested in? You can't control what he does. Don't take on the blame.