Hacker News new | ask | show | jobs
by eugene3306 125 days ago
why don't they publish at ARC-AGI ? too expensive?
1 comments
Bolwin 125 days ago
Arc agi was never a good benchmark that tested spatial understanding more than reasoning. I'm glad it's no longer popular
link
falcor84 125 days ago
What do you mean? It definitely tests reasoning as well, and if anything, I expect spatial and embodied reasoning to become more important in the coming years, as AI agents will be expected to take on more real world tasks.
link
eugene3306 125 days ago
spatial or not, arc-agi is the only test that correlates to my impression with my coding requests
link