Yeah you gotta pay attention! Actors call it "staying in the moment." Dont think about what you are going to say next. Just really listen to what the other person is saying. Actors often say that acting is really just reacting.
I got my hair cut today, and the guy before me had just the most beautiful thick head of hair. I kinda felt aware of thinking that in the old days, i would be worried about saying something wrong about it, but i just calmed down and waited awhile until it didnt feel so pressured. That was something i had been diagnosed with, "pressured speech."