|
|
|
|
|
by TeMPOraL
956 days ago
|
|
ChatGPT is the most general system ever created and packaged. You can throw arbitrary problems at it and get half-decent solutions for most of them. It can summarize and expand text, translate both explicitly and internally[0], play games, plan, code, transcode, draw, cook, rhyme, solve riddles and challenges, do basic reasoning, and many, many other things. Whether one is leaning more towards "stochastic parrot" or more towards "sparks of AGI" - it's undeniable that it's a general system. -- [0] - The whole "fine-tune LLM on a super-specific task but only in language X (which is not English), its performance for that task improves in languages other than X" part, indicating it's not just learning tokens, but the meanings behind them too. |
|
it's very deniable, as Yann Lecun correctly pointed out, it can't even walk up a set of stairs (https://twitter.com/ylecun/status/1721648856260050970).
It can't cook, it can talk about cooking. It wouldn't be able to get a pan out of a drawer. I know all we do these days is produce text tokens on the internet, but it is in fact in itself a domain specific task. If you can talk about opening a can of beans you're an LLM. If you can do that and actually open the physical can we may be a little bit further towards general intelligence.
We don't even have a full self driving system, the limited systems we have are not LLMs, and there isn't even a system on the Horizon that can drive and talk to you about the news and cook you a dinner.