If you don't want to explain to him that you want to take things slower, etc., can you just share with him selected bits and pieces, without sharing the whole ball of wax?
Perhaps you could think of a few things to share that aren't that important or don't trigger you -- and perhaps that will satisfy him.

Then you could move on to the "news of the day" or something. LOL
Let HIM do all of the talking about himself. I'll bet he'd enjoy that. lol Take care & God bless. Hugs, Lee