What you deem the "simplest" tasks aren't simple for you! Not everyone can/is able to drive well, it's a very complex task, not simple at all. Comparing yourself and what you are doing and how well, etc. to others can always wreck havoc with one's self esteem.

But you are a good trier! I don't have respect for those who fail because they don't try, those who drink and drive, for example. Some people fail at what you feel are simple tasks with no "excuse"/reason. You are doing the best you can, most people do not do that! It's nothing at all to brag about, doing things half-asped, whether it looks good on the outside or not; that is just sad, that people are satisfied being half-asped? Trying hard and failing is not "failure". You learn from your mistakes and figure out how to try again if it is something you even want to do (I took the bus to work or walked, driving was too nerve wracking and expensive).

We have difficulties with things that are difficult for us. I was laid off or fired from jobs, they weren't the right jobs for me at that time. I flunked s course in college, I should not have been taking that course. I'm not stupid, just because I got an "F" on someone else's scale, in a course "they" made for them!