The way you tell it, it does sound like he is not the greatest but it also sounds like you are doing okay. What about how you feel about your job? Do you like it? Do you value it? It doesn't sound like you are having a hard time other than wondering if your boss might not be a good boss.

Sometimes I think of people as gears. We all have issues. Think of the issues as the teeth of the gear. If your issues don't get aggravated or clash with the issues of others, you can work together well. If your issues do clash, then the teeth of the gears don't line up, the gears jam, and you get pain points.

If you like your work life and he's not clashing with you, is there a problem? He doesn't sound unethical or mean.

Wondering if you might live and let live? Choose your battles? There is no perfect job.