Hacker News new | ask | show | jobs
by fragsworth 1134 days ago
The article was clearly written by someone who hasn't used GPT-4 extensively.

"Current methods will not achieve AGI unless fundamental algorithmic innovations are introduced that enable AI to ask and answer questions of why."

This is complete nonsense. GPT-4 is already close to being able to do basically everything. All you need is the obvious improvements - better prompts, multi-shotting, bigger context, and access to other inputs/outputs.

2 comments

This claim does not make sense, transformer networks in my limited experience are limited in there learning ability (fine tuning), furthermore there planning abilities are non-existent.
I just enjoyed being a game master for a nice impromptu game with GPT-4:

https://cloud.typingmind.com/share/c0a68cb2-5f59-4e83-b383-b...

Whether or not it fulfills the strict definition of planning in AI research, it definitely looks like planning to me. More than Hanoi towers anyway. GPT-4's performance was quite enjoyable.

To incite you to click on the link and check it out in full, here's an excerpt from the game setup:

> You are in a maze. The maze consists of square fields, turns are only 90 degrees, you move by one field at a time. The usual stuff with mazes on a grid. You know the drill. Somewhere in the maze there is a MacGuffin, which I need to prove a Hacker News commenter wrong. Your goal is to find the MacGuffin, and bring it back to me.

> The game is semi-interactive. Instead of making one step at a time, I want you to string together sequences of steps to formulate a plan. Since you don't know where the MacGuffin is initially, you can't win with a single plan (or maybe you can, if you're smart enough?). The rules therefore are:

The cheap solution of giving the AI a map was very disappointing. You turned this game from "find MacGuffin" to "just chat with me for a bit, here's a map".

Also I think you forgot to decide where MacGuffin is beforehand which led you to just give away the solution for free in the end because there was no way to find MacGuffin since he's not really anywhere.

If anything this confirmed my skepticism about "AI".

Yeah, it was a cheap solution, because I wanted to finish the game early.

Playing the game to completion was not the point. The point was to test GPT-4's ability to create multi-step plans and adjust them based on new information. I fast-tracked to the ending once I believed that goal was achieved.

And yeah, of course I didn't know where the MacGuffin is beforehand. There was no map, I was inventing the whole thing on the fly - but the AI didn't know that. I didn't want to precommit to a puzzle, but rather have some flexibility to throw GPT-4 a curve-ball or two, and see how it adjusts its plan.

> furthermore there planning abilities are non-existent.

Have you even tried to ask it to plan things out? It can plan things out.

In fact, just asking it to plan things out has shown significant benchmark improvements for general questions: https://arxiv.org/pdf/2305.04091.pdf

"Close to being able to do basically everything"

A bit vague, no?