If I were you I would probably think seriously about changing jobs if possible. It's one thing to have a supervisor that doesn't believe in you, but did he literally say "you don't care" and such, or did he say "It seems like you don't care" (which is still terrible and shaming, but at least doesn't disregard that it might not be your true experience). For him to think he can read your mind and just assume you're feeling that way no matter what you say... is not cool. I don't like being around people like that. :/

Anyway, best of luck to you in dealing with this situation. I hope you can score a better job, or at least find some way to make things more tolerable at your current workplace.