Never a bad time to learn to be expressive. You can't help the situation if he gives you short answers. Demand more. Ask him to write it down if need be.

There is no way that you can be bothered by something and not have an inkling why. Maybe he doesn't want to hurt your feelings.