Hacker News new | ask | show | jobs
by bashfulpup 466 days ago
That implies learning. Solve continual learning and you have agi.

Wouldn't it amaze you if you learned 10 years ago that we would have AI that could do math and code better than 99% of all humans. And at the same time they could barely order you a hotdog on doordash.

Fundamental ability is lacking. AGI is just as likely to be solved by Openai as it is by a college student with a laptop. Could be 1yr or 50yrs we cannot predict when.
1 comments
Enginerrrd 466 days ago
Strictly speaking I'm not sure if it does require learning if information representing the updated context is presented. Though it depends what you define as learning. ("You have tried this twice, and it's not working.") is often enough to get even current LLM's to try something else.

That said, your second paragraph is one of the best and most succinct ways of pointing out why current LLM's aren't yet close to AGI if though they sometimes feel like it's got the right idea.

link
bashfulpup 466 days ago
In context learning, learning via training. Both are things we barely understand the mechanism of.

RAG is a basically a perfect example to understand the limits of in context learning and AI in general. It's faults are easier to understand but the same as any AI vs AGI problem.

I could go on but CL is a massive gap of our knowledge and likely the only thing missing to AGI.

link
tw1984 465 days ago
> RAG is a basically a perfect example to understand the limits of in context learning and AI in general.

How? RAG is not even in the field of AI.

link
bashfulpup 465 days ago
Long explanation. Simple terms, you can't use a fixed box to solve an unbounded problem space. If your problem fits within the box it works, if it doesn't, you need CL.

I tried to solve this via expanding the embedding/retrieval space but realized it's the same as CL and in my definition of it I was trying to solve AGI. I did a lot of unique algorithms and architectures but Unsuprisingly, I never solved this.

I am thankful I finally understood this quote.

"The first gulp from the glass of natural sciences will turn you into an atheist, but at the bottom of the glass God is waiting for you."

link