Sounds like you and your brother need to sit down together and make a list of rules that both of you can agree on. Something that applies to everyone in the house whether it be his kids or your cats. Every household needs structure. I think it would do you all some good really. Just a suggestion..
-Jennifer-