[inciampati]

One thing I'd like to see is more effort on developing citation systems for these models.

What I mean is that every part of the output of an LLM should be annotated with references to the content that is most important or relevant to it.

Who is leading this effort now?

[astrange]

It's not possible to do this without a completely different and less efficient architecture. You can approximate it, but it won't give you the correct answers, as there are no correct answers insofar as the model is learning to generalize rather than memorize things.

https://twitter.com/AnthropicAI/status/1688946685937090560