The first couple years of college are about taking basics in most other subjects (unless you have predestined yourself for math or a hardcore subject like engineering?) so I would use them to explore other subjects and maybe different aspects of the subject you are good at?
It is hard to be locked-in to a career early, one's experiences in other things to know what other areas one might like to explore are not there yet so I don't think anyone will mind if you tell them you are feeling burnt out about the subject you use to like so well.
Give yourself permission to explore other areas; there's no right or wrong way to live your life, it's yours! If you stop to smell the flowers, so-to-speak, the bluebird of happiness won't fly up your nose in spite