yes, i have been on his side. depression does make it torturous to interact with people. you are constantly worrying about keeping up appearances, feeling okay, being likeable - while not having the energy or motivation to talk to anyone.

don't take it personally. you are not a horrible person either. it's likely your ex really resents himself for not being okay around people.