Usually or dreams are not as straight forward as we assume. It probably has nothing to do with a desire of your ex but just a desire of sex. Maybe he was the most memorable, but I'm sure you're far past him.