I think too that you should wear it! It's even nicer that it has a positive history to it, and that you feel warm towards him even though your marriage didn't work. Doesn't happen that often, so I think you should wear it and enjoy it :-)