Hacker News new | ask | show | jobs
by szundi 976 days ago
Problem is ChatGPT is feeding on SO
1 comments

Exactly. I've already hit the dreaded "knowledge cutoff" of 2021.

What happens when this training data is 10 years old? Where will we get new data?

In the meantime we'll get used to functioning with these models with assumption the "knowledge cutoff" will just be moved. But if there is little new data, how? Furthermore, how do we prevent feeding ML generated data to ML training in the first place?