Your marriage sounds abusive -- psychologically at least. Just remember this: it is not your fault. I know that's kind of cliché but always tell yourself that you deserve the best. He lied to you, and chances are, he will lie again. Maybe he'll be more discreet next time, but I don't believe that this is a healthy relationship for you.
That being said, I'm by no means a marriage counselor and I don't know what is going on in your life besides what you just posted, but always remember, this is your life and you have the power to choose whatever path you'd like to take. Are you happy with this man? Do you love him and can you see yourself spending the rest of your life with him? If you have trouble answering these questions then you have found your solution.
Choose the path that will make you happy.