I want intimacy, but at every opportunity I shy away from it. It hurts

I'm not sure what my issue is, I've always been like this. It's not fair to any of my partners in the future. To want to be touched but draw away so quickly. I hate it and don't know why I'm like this.