[gobdovan]

IQ tests are restandardised from time to time. We could take the scores from 100 years ago and see that everybody would be gifted.

Intelligence is usually defined as the skill in pursuing a goal, or speed of acquiring the ability for pursuing given goal. Given the goal-dependent nature, it's not that useful to use the same tests and measurements for intelligence over time, be it artificial or not.

[gobdovan]

[0] JR Flynn: The mean IQ of Americans: Massive gains 1932 to 1978.

[1] Legg, S., Hutter, M.: A collection of definitions of intelligence

[2] François Chollet, On the Measure of Intelligence

[skeledrew]

So it's an ever-shifting goalpost, which makes it pretty useless as an objective.

[gobdovan]

Yeah, but there's attempts to fix it. The Cholet paper (https://arxiv.org/abs/1911.01547) is a good attempt, shifting from measuring ~skill to measuring ~acquiring skill. It's the framework behind ARC-AGI benchmarks.