Don't feel alone. Relationships are difficult. I'm not going to tell you to leave him. Perhaps you need to learn to set boundaries and perhaps he will learn to accept them. Perhaps he was new to feelings and perhaps the past will stay in the past. It's not all doom and gloom. But see a therapist. Get some professional guidance, don't isolate and don't settle. That is all. Hugs to you