If you're uncomfortable with it, I don't think it's unreasonable. You should be able to do what you feel is best for your family, even if other people disagree.