I think conversations are more difficult when you feel a boundary is being crossed....like someone trying to get your phone number. You have to remind yourself that you have a right to refuse a request if it doesn't feel right. Politely refusing and offering an alternative you are comfortable with seems like the right approach. .