Well, some people might not like the book, and some people might even think they know you just because they read the book. But they can't know you just from reading your book, even though it's autobiographical. Since they don't know you, they cannot dislike you.