I don't think it's a doozy at all but I don't think it's a big issue. If you are not currently seeing anyone then it is not a big concern. If you start dating you might let the person know you have trouble initiating physical contact. They could be ok with it. I think you worry very prematurely.