These are a few helpful articles that may help you overcome the feeling of regret and allow you to forgive yourself.

thedailylove.com/how-to-liberate-yourself-from-regret/
rockyourday.com/how-to-stop-regretting-the-past-and-start-building-your-future/