I have done this before, but I found that in the next session if I told him how I was feeling about the appointment, he was reassuring and asked what we could do for the next time to fix that, since then I haven't missed anymore hehe