What about telling him what you think is the truth ... that discussion prior relationships and their details is not healthy for either of you or your relationship? And refuse to go there no matter how insistent he is.