I'd disclose somewhere in the relationship where you two aren't too deeply involved that if he doesn't want to be with someone who has emotional baggage, it won't be such a deep personal blow.