Trippin nailed it...I am so, so sorry.

He is outright cheating on you, no matter how you try to paint it.
I don't like advising couples to split apart...I don't feel it's my place to do so. However, what he's doing on the scale he is doing is, to me, a deal breaker.
I am sorry. I hope things work out for you. Please feel free to PM me if you'd like to talk or if I can be of help.