I agree that it would be best to talk about this with him. As odd as it might sound to you, he may have been trying to be reassuring you that these things are okay and can be worked on.

See how he responds to your questions, your concerns, your feelings about this when you talk about it. Ask him directly what he means and to explain anything you don't feel you understand. Tell him how you feel (angry, frustrated, afraid, annoyed, etc).