[backend_dev82]

I heard from Ed Zitron that you can't really turn off "training" on these models even after they have been released because they need continuous re-training to keep up with the changes in the world and the language etc. Is this correct? if it is, can we even say that research can be turned off entirely?

[spongebobstoes]

it's completely false

[koe123]

I do at least think its certainly the case they cannot stop R&D: no moat without being ahead of open-source right?

[backend_dev82]

So model drift is not really a thing?

[loandbehold]

You don't need to retrain model from scratch to add small of additional knowledge like recent events.

[backend_dev82]

Thanks