I understand what you are expressing. I'm not personally convinced that this is strictly because of your religious upbringing. Similar statements have been made historically with varying reasons as motives, to justify the desire to stray.

I'm sure the upbringing caused it's own damage, yet, life is typically much more complex than that.