There are many aptitudes and kinds of intelligence; because you may have difficulty with math doesn't say anything at all about how "smart" you are.

I would get a tutor for a bit now or go to the student learning center and work a bit with someone on the basics you might need to know to move forward. Just throwing yourself at your fears is not going to have a whole lot of effect on them I don't think; they don't care :-) Find someone who can hold your hand while you take the course and give you whatever extra help and support you may need. Work now to find such a person before you need them. Everyone needs help; needing help is not "weak" nor does it mean you're "stupid".

Concentrate on what YOU want to do for yourself, the material doesn't care if you like it or are afraid of it, etc. It's just facts/information. Don't give your fear energy of its own to defeat you. I use the idea, "you're the right size, it's the pants that don't fit!" to help myself, and I'd adapt that or find a phrase that helps you remember that the material is inanimate and you are "in charge".

The math is there to help you, to expand your life and make it easier, not to get in your way. Treat it like a friend and "talk" to it, ask it to show itself to you in ways YOU can understand. Find a good tutor who can show you concepts many different ways and ways to illustrate things so you can understand and remember easier and so it's fun and like a game. Think of it as a enjoyable puzzle instead of a horror story.