Hacker News new | ask | show | jobs
by jasonjmcghee 1139 days ago
Nothing to do with being sentient.

I think it has to do with being able to teach itself arbitrary information, including how to learn better, and importantly recognize what it does and doesn't know.

LLMs feel like a massive step towards that. It feels similar to a single "thought process".

A "good / useful AGI" might have aspects such as: - Ability to coherently communicate with humans (hard to prove it's working without this) and other agents. - Ability to make use of arbitrary tools

This sounds very similar to AutoGPT (what people poke fun of as an llm in a while loop)- and if the brain was AGI- I think it'd work very well.

I think there's a critical difference between LLMs and AGI, which is metacognition.

If an LLM had proper metacognition maybe it would hallucinate, but then it would realize and say "actually I'm not sure and I just started hallucinating that answer- I think I need to learn more about xyz." And then (ideally) could go ahead and do that (or ask if it should).

Another piece I've thought about is subjective experience.

Inserting experiences into a vector store recalling them in triggering situations.

1 comments

I'm not sure exactly what you mean by metacognition, but I suspect you mean something that I think is critical - the ability to watch itself think.

That is, humans can sense the surrounding world. (Some people call that sentience.) Humans can think about what they sense, organize it, categorize it, find patterns, think both inductively and deductively. (Some people call that sapience.) But humans can do something else - as they think, they can observe their own thinking, and then think about that. "How do I reason? Why did I decide that? How do I determine what evidence is accurate?" I don't know if "metacognition" the the word that people use for that, but it's part of what I think AGI is.

Yes- being able to reflect on its own thoughts.

You could argue being able to observe and think about what was just said aligns with ReAct (https://arxiv.org/pdf/2210.03629.pdf) - maybe a tweak to directly assessing a previous thought, and modifying output / thought process based on the assessment accordingly would help, but I'm not sure that's quite enough.

If it can't ask "why" and step back through why it thinks something, I think we'll keep having the confident hallucination problem- rather than "I don't know".

But maybe that's touching on the quality of AGI.

Is "reasoning" a necessity for the base definition?

But I suspect you mean something that I think is critical - the ability to watch itself think.

That's pretty close to the way the term is normally used.

FWIW:

https://en.wikipedia.org/wiki/Metacognition

https://plato.stanford.edu/entries/self-consciousness/#Meta