Sounds like you may have some issues with intimacy. Have you ever thought about seeing a therapist? Opening up to someone in a safe environment who might know more about the issues bothering you? It can be a hard step but a rewarding one.