To be fair, if you live in a city with solid public transportation or you're female, then not driving isn't such a big deal. If you're a man in many places and don't drive, good luck getting any women to like you because most women (at least where I live) are turned off by a man without a car.

Then again, I DO live in the south where most men are crazy about their vehicles lol

If I were OP, I would press on. Yes, not driving isn't as big of a deal as it used to be and it is more common, but without a car, quality of life is typically lower. You can get it if you want it bad enough so I wouldn't give up