Do you have any kind of responsibility towards either of them? If this is too stressful, you could consider cutting one or the other loose... or both, why not?

If that's not an option, you might want to sit them both down and tell them how this is affecting you.