[adamddev1]

And then the AI gets trained on the advice and information subreddits, and we see an exponential growth downwards in quality?

[tripleee]

Isn't AI getting more accurate over time though, as per benchmarks?

[sandeepkd]

> as per benchmarks

That seems to be the key and its risky when the measure becomes the target itself. When you already know the benchmarks, and that drives the definition of success outcome then there is every incentive to just chase them

[crooked-v]

Yes, but that's with mostly the same data as before, just with more of the preexisting dataset and more RLHF. We haven't seen the ouroborous eat itself yet.