I guess the question I have for you is if you feel safe and what does your gut instinct (or still small voice, whatever you want to call it) tell you?

It's one thing to be a grown woman having a grownup experience. It's quite another to be discussion some kind of childhood experience and be more in that age range mentally and having some feeling as you describe. I'm no expert on transference, and certainly have my own issues with it, but sounds like being held by him brought up some strong feelings.