You always have the right to say no. Its your life.
But remember you are a good person and kind and brave and caring! They maybe as scared as you!