|
|
|
|
|
by giobox
41 days ago
|
|
> they don't have a used by date For quite a lot of use cases, the current systems arguably do get worse over time if not continually updated. The knowledge cutoff date will start to hurt more and more as the weights age in a hypothetical scenario where you are stuck with them forever. Coding, one of the most popular usescases today, would not be great if it say only understood java to a version from years ago etc. https://en.wikipedia.org/wiki/Knowledge_cutoff |
|
This LLM trained only and entirely on pre-1930s texts was able to code Python programs when given only a short example:
https://talkie-lm.com/introducing-talkie