Taking care of an elderly person means a lot to the person and the family. Nothing to be ashamed of. You can always look for something else when you feel more confident. And don't forget, being an awesome caregiver is a good reference, too.