Perhaps when you go back there, you remember things that made you sad/angry or whatever.. basically, it's a triggering place. Could it be? What memories do you have about that place and the time you spent there?