I got on SSDI despite being young and having a work history, couldn't get SSI because I had more than $2k in the bank at the time. SSI is based on what you have in assets, SSDI is based on your current income.
I say apply and talk to the lawyers again if you get denied. Most people get denied the first time around (although I didn't). I mean, you have multiple MDs saying you should be on disability, it's worth a shot.

edited out something I could have remembered incorrectly.