I agree with Yoda in finding an alternative living arrangement for your brother. If you let him live with you you'll both go down. It also sounds like you and your brother could use some therapy to deal with all the losses in your lives. To me it appears your brother may have some abandonment issues and that is why he is so clingy to you.

Best of luck and I hope you get over this rough patch.