Maybe godel, escher, bach would be a better "book that people talked about but never read"
Fun fact: The very first book ever sold on Amazon was "Fluid Concepts And Creative Analogies: Computer Models Of The Fundamental Mechanisms Of Thought" also by Douglas Hofstadter