Hacker News new | ask | show | jobs
by infinityio 935 days ago
I'm not quite sure what you mean here - English Wikipedia is ~60GB, and there are definitely models trained on Wikipedia that are less than 60GB (eg: Llama 7B), but that's a lossy store of information - you won't get perfect recital of a Wikipedia page from an LLM