I think having trouble saying 'no' has to do a lot with feeling responsible for the other person's feelings or emotions and not wanting them to be upset or disappointed with us. It took me years of therapy and then sobriety to be comfortable saying 'no' and not feeling like I somehow "owed" the other person an explanation. I had to learn that my feelings were equal to the other person's feelings and that protecting myself was a worthy cause.