I would definitely bring this up with him. I agree with swimmergirl - if he's unbuttoning his shirt during session, that is just downright inappropriate, no doubt about that. Ask him about it and try to gauge his reaction. Does he become defensive, or is he calm and understanding and willing to discuss it further?

Keep talking if it helps x