Are you sure it's him feeling unworthy etc? Could be he simply is unhappy and doesn't want to be married? Did you ask?

My ex husband ( long ago) acted like this. Didn't want to be married, wasn't happy but had no guts to leave. So I left. No way I'd stay too long in this.

Have a serious talk and if he refuses to improve then you know what to do. The way he acts he doesn't seem to be a soul mate. If you have kids it would be tough but you don't want kids to look at bad marriage and replicate it. No touching and no talking.... Sorry you have to live like this

Sent from my iPhone using Tapatalk