[kelseyfrog]

See REALM[1] for some older(2 years) work on this idea.

1. https://arxiv.org/abs/2002.08909

[sdenton4]

Or RETRO, from deep mind, last year.

https://www.deepmind.com/publications/improving-language-mod...

[ricopags]

Or Meta's Atlas[0] for more recent work

[0]https://arxiv.org/abs/2208.03299