Detecting your IP address still wouldn't give them access to that information... unless they have access to Google's servers as well.

I mean, yeah, if someone can hack into your Google account or your computer to access your browser history, then they'd be able to find it out.