I think it's actually a nice trait to remember details about people and conversations, I'm quite like that myself, it means you're interested and listening.