Unless you agreed to an open marriage then its boils down to cheating and that is not acceptable to you.. Regardless if hes friends are a part of this doesnt much matter "he" told you.

You may want to speak with an attorney and find out your legal/financial issues/child support and visitation etc if you do wind up divorcing.

Take care