I would just bring up this whole experience first thing in next session and discuss with him. Ask why he did not respond earlier. You reaction might be informative in the context of your treatment.