Hacker News new | ask | show | jobs
by gbnwl 559 days ago
There’s huge fears around AGI, but that’s not what people are building.

Everyone is trying to build this.

1 comments

“Trying” is an overly generous interpretation of what’s going on.

Training an LLM is not actually working on AGI just as people building skyscrapers aren’t getting to the moon. It’s an inherent limitation on the approach.

Training LLMs is not the only thing people are trying. They dominate the public attention right now but there are people everywhere trying all kinds of approaches. Here's one from IBM: https://research.ibm.com/topics/neuro-symbolic-ai

First sentence: "We see Neuro-symbolic AI as a pathway to achieve artificial general intelligence"

I agree some people are doing novel work, but that’s a long way from “Everyone”.
Everyone is trying to get to AGI, and yes mostly through LLMs for now.

You said you don't believe LLMs are capable of ever getting there, so I offered a link showing people are trying other things as well. My point was never "Everyone is doing novel, non-LLM work towards AGI".

But everyone is in fact trying to get to AGI:

Google: https://www.fastcompany.com/91233846/noam-shazeer-back-at-go... https://deepmind.google/research/publications/66938/

Microsoft: https://www.microsoft.com/en-us/bing/do-more-with-ai/artific...

Meta: https://www.theverge.com/2024/1/18/24042354/mark-zuckerberg-...

Salesforce: https://www.forbes.com/sites/johnkoetsier/2023/09/12/salesfo...

Not to mention obvious suspects (OpenAI, Anthropic etc). Just because you think it won't work doesn't mean they're not trying. Everyone is trying to get to AGI.

OpenAI has specifically said LLM’s aren’t a path to AGI, though they think they have utility in understanding how society can and should interact with a potential AGI, especially from a policy perspective.

Your other examples are giant companies with many focus who can trivially pay lip service to fundamental research without spending any particular effort. Take your link:

“Benioff outlined four waves of enterprise AI, the first two of which are currently real, available, and shipping:

  Predictive
  Generative
  Autonomous and agents
  Artificial general intelligence”
That’s a long term mission statement not actual effort into AGI. So if you’re backing down from actual work to “trying to get to AGI” to include such aspirational statements then sure, I’m also working on AGI and immortality.
Please, before we discuss this further, and I would like to, provide some idea of what would qualify as an "actual effort into AGI" for you.
> It’s an inherent limitation on the approach.

What's your evidence for this?

AGI needs to be able to generalize to real world tasks like self driving without needing task specific help from its creators.

But the current LLM process separates learning from interacting and the learning process is based on huge volumes of text. It’s possible to bolt on specific capabilities like say a chess engine, but you’re now building something different not an LLM.