|
|
|
|
|
by jononor
457 days ago
|
|
Not the team, just follow ARC on-and-off as a ML engineer. I think it will take a few years (at least) to see the impact of ARC, especially the more conceptual works. Those are more close to basic research than applied - It will take time before the lessons are transferred to applications (that also requires considerable R&D).
But more importantly, current LLM-based systems and the in-the-spirit-of-ARC-systems have quite different goals. The ARC challenge is intended to measure and build system which can learn efficiently - that is, be able to solve a novel task with very little new data. Ref F. Chollet paper "On the Measure of Intelligence".
Current LLMs do not care for learning efficiency at all - actually the strategy is completely opposite - they aim to utilize ss much data and compute as possible to make the most capable system (at least on task that are somehow spanned by the training data). Which works well, but is for sure quite costly and it might also limit applications to those that not require a lot of learning at runtime (we still do not know how far we can take in-context learning).
ARC brings in a fresh perspective, but I expect it to take several years for the approaches to really start cross-pollinating. |
|