I think it is very normal to have anxiety issues about driving. Beginners or in weather or at night or in the rain..... these can all be issues that can be unsettling.

BUT - I also think with practice. You can eventually get past these. It will take time. But if you practice say twice a week for a few months. you will gain some self confidence and even a little bit of a feeling of mastery (DBT terminology).

Good luck to you.