I'm the same way. I need to be sure the places I give to are legit. Plus, I don't have that much money, so I need to be pretty conservative to where I give and how much. Sometimes I feel I'm being selfish, but there's no point in giving when there's nothing left for myself.
You're a good person, who's being smart in giving. Hugs.