[ctoth]

> The latest batch of language models can be much smaller yet achieve GPT-3 like performance by being able to query a database or search the web for information[0].

[0]: https://jalammar.github.io/illustrated-retrieval-transformer...