I agree, stop blaming yourself. Just accept that it happened and look at what you might do next time something similar appears to be happening. But you should also recognize that although you could have been more upfront, he also made mistakes and did things that were not ok.