[amelius]

You might be right, but human knowledge is also expanding, of course. The question is: will it expand faster than hardware capabilities?

Anyway, I wish we'd see more search and NLP related posts here on HN. It deserves far more attention than it gets.

[romo3]

For the average person this rate does not matter. They don't need access to the cutting edge of quantum physics, astronomy, dance, art or javascript.

All you have to do is look at the speed at which new info is being added to Wikipedia and Stackoverflow which is stabilizing, i.e. it is not growing as it once was. Basic/foundational knowledge is more or less all covered. https://en.wikipedia.org/wiki/Wikipedia:Modelling_Wikipedia%...

And that sum total comes to 50-60 GB compressed. Think about that number. It's not big.

[weaksauce]

The sum total of our collective intelligence is equal to an install of gtaV... Crazy.

[panglott]

Wikipedia is not the sum of our collective knowledge. It's little more than the preface.

[amelius]

We're talking about the "long tail" of information, which is huge also outside of science. Think popular culture.

[curioussavage]

It would be awesome if you could download dumps of wikepedia filtered by category so You can get the size down. Probably a lot of information that is useless to me in there

[freeflight]

Kiwix does this, at least to a certain degree: http://wiki.kiwix.org/wiki/Content

[TheGrassyKnoll]

Listen to Wikipedia http://listen.hatnote.com

[QAPereo]

NLP is rightly ignored.

https://en.m.wikipedia.org/wiki/Neuro-linguistic_programming...

Edit: Fortunately I'm left feeling foolish, rather than horrified.

[cantagi]

The GP probably meant https://en.wikipedia.org/wiki/Natural_language_processing