In any relationship, it is not healthy to go with the other person just for the fear of feeling guilty to let that person down. This will make that person has control over your life, which will ruin your life because no one wants to be controlled. This is a given. You may allow some minor things to flow against your will if it means something to the other person, but not all the time. Manipulation is the worst in any relationship. Honestly is a key in any relationship. This isn't love. Love is a compromise, that both of you find a common ground on what satisfies you both and will progress your joint interests. Empathy and affirmation are both necessary in any relationship. Having said that, walking away is not the only answer.