Sounds like you were willing to try.
Maybe reflect and consider your reasons for continuing to try - what you are hoping for, and do your hopes coincide with his hopes?
Can your areas of concern be resolved?
His own behaviour of involvement with others sounds like he's not really commited to your relationship - so he does what he wants to do. Are there any dangers to you - because of his involvements with others (the multiple affairs)? Is he using precautions to protect his sexual health when he has these involvements with others? If he isn't - then this is putting your health at risk. You don't want any STDs - they can be lifelong with a lot of health problems.
Having all those multiples affairs - what does he value?
What can you anticipate for the future?
Maybe try your own personal counselling first, before couple counselling - in order to clarify your own mind first.
Is he motivated to invest much effort in couple counselling?
And think of your own options for the future.
Sure do hope things work out okay for you.
Just wondering - why does he stay?
And why do you stay?