Not sure how your thoughts on what other people think about your marriage has any bearing on your feelings. A lot of difficult marriages "look" great from the outside.

Unless he becomes dangerous when mad, go to counseling and let him get mad. lol, maybe he will decide to join you in counseling, to defend himself after he hears what the counselor tells you.