[jtxt]

One way I tried to do this is by having it write an answer, and a footnote reference at each fact. [1] then list search terms that be used to verify each claim, then I would respond with the url and quotes from found pages for each one, then have it rewrite the answer based on that information and cite the sources. I think something this direction can be automated. I saw someone do this with math and other tasks, that would talk to a connected program before answering.

[visarga]

Yes, it's been done both in papers and in various GPT-3 projects. As long as you can find relevant references the LM will become reliable.

[adamsmith143]

I did this as well and it looks great initially but there are already examples of GPT generating totally bogus references and sources. So we're back to square 1.

[politician]

Sounds like an interesting way to reboot Wikipedia.