I don't believe there is a blanket answer that applies to everyone. It would obviously be harmful to Rhapsody from what she's said, but I know several people who have strong marriages despite swinging. So I don't think it's a 'yes' or 'no' kind of question. If you're not comfortable with it, then I'd say that the chances are high that it would be harmful to your marriage.