Have you thought about looking into online college at all? I know that that can be a great option for people who have trouble going to traditional college--in your case that seems like more of a difficulty with the environment itself and not with you! If you have a counselor at school or a therapist maybe talk with them about other options? Going to college has been wonderful for my mental health overall, but I have a large group of friends that can watch out for me--being alone on campus is still frightening for me, as my anxiety still exists, but the coping mechanisms I have developed have helped a bit. However, college campuses are not for everyone, and especially if your mental health isn't at its best it can be a lot to take on. Waiting a bit to try college might also be an idea.
Please keep us updated on what you decide to do! Best wishes!