Transitioning to professional work is always a challenge and so is starting any new job, no matter what. It takes a few months to get your feet wet and to adapt, but once you do adapt, it becomes far easier. I wouldn't run from the challenge just because it's hard. It's hard for everyone who starts a new position. I say rise to the challenge and pursue your goals of getting off of disability.

I fight my way through my depression and anxiety and I work full time. I am on medication that helps me.

If you can do it, I say stick it out. IF after a year you still feel the same exact way, then I would say it's time to shift gears.