I am not great with touching. I was never a cuddly child either, then again I grew up with an emotionally abusive mother so I never felt 'safe'.

It might help to figure out where you think the dislike of touch sprouted from. My guess is that there is something in your childhood there.