Darkeyes wrote an excellent post, I agree with it all, she stated things perfectly.
I myself am a single Mom. I've been in your shoes, catgirl. No money, mattresses on floor, kids from much more well off families visiting.....and what really counted is that I loved my son, still do, he is now 25, and he is doing fine. He is doing fine even with being raised by a disabled single Mom on public assistance.
Love and relaxation, healthy humor, compassion and truly caring for each other far, far outweigh any material means, any standing in wealthy society. Of course better financial means would have made our lives easier, often things were a struggle, but keeping my eyes on the truth helped immensely.
Big hugs to you and your family. You and your children come first. People in your community should be supportive and admiring, or just keep their mouths shut.