"I had a whole agenda to come in and talk with you about today and I didn't because I won't." No one can "make" you except yourself. Even if he "prompts" you (which it sounds like he's been trying to do anyway?) you can still "won't" about it. You have to force yourself and just go for it. Would writing something out and reading it to him help? Then maybe you could talk about it because it would be out there?