Hacker News new | ask | show | jobs
by bit1993 61 days ago
> I think the cutoff date is closing in on our current now. If models cannot easily become bigger, they will likely advertise using "up-to-date-ness". Maybe they will be merely a few days behind. Or bigger models will make use of smaller but more up-to-date models

But they will still rely on assembly, C, Rust, Linux, HTML, TCP/IP... Doesn't matter how up to date they are, they rely on existing code they have been trained on, they can't just create new languages without the training data.

1 comments

Except they already have invented new languages.

https://medium.com/@trezzescience/the-ai-that-invented-its-o...

That's not what I mean, even I can invent my own language that only I use, but if that language is not widely deployed and used by other people or LLM models, it's just a toy language.