Hacker News new | ask | show | jobs
by aantix 1612 days ago
With 50TB, and if you were doing a full text search, wouldn't the entirety of the index have to be held in memory?
1 comments

No. Full-text indexes exist.
You can also do an incremental/streaming search. Lots of ways to avoid loading it all into memory at once, yeah.