He does sound depressed. I don't know how long it has been since the divorce? If it's been less than a year, he may just be going through a tough period of adjustment. If it's been two years or longer (just a rough estimate) it's more worrisome.

I'm not clear about whether you and your sister live with your father.