This problem does not sound stupid whatsoever. My sister suffers from this, and at the begin of her relationship with her husband, he was very non affectionate as well. I think they may have bonded because of mutual turbulant relationship pasts, yet are very much in love but it takes a much keener eye to see it.

However, lately he has become "touchy feely" "mushy" and "weird" in her eyes. For whatever reason, He suddenly wants to cuddle, hold hands, and basically be what she thought he was not. Our father passed away last year, and while I always knew she was not the physically affectionate type, I didn't notice the extent she pushes away his attempts to be close to her in this manner. Even he would try to hold her hand at the funeral, and I watched her push it away...which was really upsetting to him I could tell.

I told her the same thing I am telling you when she expressed to me that she was scared he was going to leave. Make sure he knows he is special to you in any way possible. Do things for him that only you know how to do. Things that are unique to him, you know he wants, and only someone who has been in his life for the past 3 years plus can do. Keep working on your intimacy issues, because you're right to see that it is a problem that you need to wrap your arms around, but don't put this extra strain that he will leave you if you don't instantly change overnight.

Some of us men are affectionate, I am extremely guilty myself. To a point where my sister actually criticized me for showing to much PDA with my last girlfriend. People are just different, and if you have made it this far with your husband, the truth is he knows this about you. As long as you make him feel loved in other ways and continue to show him that you are attempting to work on yourself and not just giving excuses, trust me, he will not leave.