Go back to work. It'll be good for you. I was scared to go back to work as well after I was in the hospital, but other than mild residual anxiety/paranoia I've been okay. You may find that you'll be okay as well, and maybe even feel better. I think the anxiety/anticipation about going back may be worse than the act of actually going back.

But that's just my opinion.