My mother is in a situation like this. She wants to go on a trip with me but is afraid the rest of the family will wonder where she got the money. It's not a good look, but I wouldn't say that it's completely wrong. It might be enough for these people to not want to help you again. They likely didn't want you to pay them back because you said you were in a bad financial situation.

Technically, f you don't owe any money, then it's none of their business how you manage your finances. Can/Will they form opinions? Sure. But their opinions don't have to effect you. I would be really surprised if someone confronted you about this, to be honest.