No, I don't think you're out of line at all. He may have given a poor response, but you definitely should not feel like you did anything wrong.