I also do not think that you should have responded when he asked you questions about your sex life with anybody other than him.

If he discloses information on his sex life or lack thereof, with his wife (let us not discuss whether he was truthful), it does in no way obligate you to reciprocate by talking about your sex life. And his accusations, his claims that you were embellishing, were pretty outrageous.