Hacker News new | ask | show | jobs
by edgyquant 952 days ago
Okay but in reality an AGI is just an agent that can learn new things and reapply existing knowledge to new problems. Generally intelligent, it doesn’t have to mean anything more nor does it imply godlike intelligence.

Everything you just mentioned seems to be some philosophy of sentience or something. A few years ago when ANNs become popular for everything, general intelligence just meant “can do things it wasn’t explicitly trained on”

2 comments

This definition is itself tautological and also quite flawed. For example at what point in this machine’s development has it attained AGI? What if it learns to/is taught to stop learning? What if the machine is not capable of, e.g. math? What kind of knowledge is legitimate vs illegitimate? In many ways the concept of AGI masks a fundamental social context of the machine to obey standards and only adopt the “correct” knowledge. This is why, e.g. instruction tuning or RLHF was such a leap for the perception of intelligence, because the machines obeyed a social contract with users that was designed into them
This sounds a lot like "If we throw out everyone else's definition, then my definition is the obviously correct one".

Can you give any reason why your definition is correct, and/or why all those others should be dismissed?