Taking notes to your appointments is the answer. Even if it's just a couple minutes in the waiting room, I always try to lay out things that are on my mind. When you only have a brief period of time to talk things over, it's really easy to get derailed by something else and either forget what you wanted to address or run out of time.