You can definitely go to college! I just graduated from a University and have been dealing with Bipolar for about 9 years or so.

My advice would be to avoid overloading your schedule and make plenty of use of on-campus resources (if you attend a large university). I received free(!) counseling from the counseling center which was staffed by by psychiatrists and psychologists, and there were countless other resources if I needed them.

But also be aware of your needs--emotionally, mentally, socially--and plan accordingly. There are many paths to academic achievement, and don't let anyone tell you what is best for YOU.

Also I would have some reservations with a 504, only because I think you should be absolutely positive about a diagnosis before it is included on any official or legal forms. It seems that you might just be starting to get help for some mental issues, so I would not be quick to assign a diagnosis. There is definitely the social stigma aspect as well, unfortunately.