All of therapy is learning how to talk about and think about the things we avoid.

Tell him the truth. He may already know. Attachment in therapy is healing.
He wants you to not have to suffer an abrupt separation. I hope you can allow yourself to risk what it is you fear and want to avoid so you can talk to him about ending. It is important and very meaningful to you.