Start outside of sex, but in a more intimate situation. Each of you can sit in a chair that is very close to the other. One of you will have to open their legs for the other to be right against them. Put your hands in each other's hands and look into each other's eyes for 2 full minutes.

Hug for 1 minute.

Then go do something. Maybe you talk, maybe you watch some TV. But the importance is that it gives you a chance to become comfortable looking into your partners eyes outside a stressful situation (like sex). Do this every night that you can and it will hopefully help you grow more comfortable.