Well, the people who think a person is great when their spouse doesn’t are generally only seeing what said spouse wants them to see. What really matters is how you feel, because your relationship with him is closer (in terms of time/proximity, at least) than the people who think he’s a great guy. So naturally you’re going to see him differently than they do, and it’s ok to acknowledge (even if just to yourself) that he isn’t who they think he is. The next issue is what you do with this knowledge, or what you’d like to do, bearing in mind that he won’t change unless he wants to.
You could be a multimillionaire living in a palace and still be miserable because of unmet needs.