Would it help to write down all your feelings about his request? Maybe that can be your first step. You can go into more detail with your fears and concerns.

BB