It is really up to you. I did my degree in university in psychology. I never took calculus, and I was okay ultimately. But it depends on what you want to do afterwards.

Can you see a guidance counsellor or academic advisor about this? They'd probably be able to give you better advice.