I think couple's therapy would be a good thing for you guys, as well as some more open communication. It sounds like there is a lot going unsaid. Don't give up on your marriage, maybe the two of you can come to a compromise.