|
|
|
|
|
|
by Wowfunhappy
32 days ago
|
|
|
> But one thing scares me a little. What if LLMs slowly become worse? Think about it. Everything written before 2017 was made by humans. After 2017, LLMs started filling the open web with their own content. And now that same content is being fed back to train the next LLMs. An LLM can give you perfect grammar and a rich vocabulary, but it can quietly lose the real context. Right now the share of AI content is small. But what happens when it keeps growing? Have the last-generation LLM pre-screen new training data for the next generation LLM. |
|
|