Your wedding day is about you. You probably won't need to field any questions about him, to anyone, on your wedding day.
Do what feels right for you. Many leave others out, for similar reasons. I probably wouldn't rub his nose in it nor flaunt it to him, but who wants to be subjected to potential tears on their happiest days?