|
|
|
|
|
by unknownfuture
16 days ago
|
|
> This is obviously untrue so either the author is knowingly lying or is plain incompetent. We had LLMs not being able to do simple high school mathematics a year back, now it is solving open problems in mathematics. Fields medalists in physics and mathematics are using it on a daily basis. I'm confused, how do you think this disproves the claim in the article? What do you think that quoted portion was talking about? |
|
> A year ago, we verified a preview of an unreleased version of @OpenAI o3 (High) that scored 88% on ARC-AGI-1 at est. $4.5k/task
> Today, we’ve verified a new GPT-5.2 Pro (X-High) SOTA score of 90.5% at $11.64/task
> This represents a ~390X efficiency improvement in one year
https://x.com/arcprize/status/1999182732845547795
This is not even including newest improvements. GPT 5.6 beats GPT 5.5 by 1 OOM.
https://x.com/GregKamradt/status/2075274981794300113