A 1 year old OR a 3 year old separately require a lot of energy and together even more. Unless the babysitting is at night and after they are in bed, it sounds like it would require more from you than you have to give at this time.
I'm wondering if you and your mom could do it together. It might be fun