Have you thought about suggesting that the two of you see a marriage counselor? It sounds sort of like one or both of you need a counselor to help you iron out the issues that are causing problems for you.