Hacker News new | ask | show | jobs
by zamadatix 980 days ago
As the resulting combined system of anything you use a book, search engines, wikis, and forums as part of is unlike the raw source information by itself sure. The ChatGPT "AI" isn't an autonomous thinker performing its own actions based on reasoning of what's fed to it. In all it's in no different than any of our previous systems in that it's "just" (still very useful) compression and next-token-predictor which is so good at prediction it is able to be used for tasks we previously thought we'd need an actual AGI to accomplish.
3 comments
famouswaffles 980 days ago
>The ChatGPT "AI" isn't an autonomous thinker performing its own actions based on reasoning of what's fed to it.

Yes it is. Or it very well could be. Agency is trivial to implement in LLMs.

https://github.com/microsoft/autogen

https://arxiv.org/abs/2307.07924

The intelligence and tool access of the LLM in question is the only thing stopping things from being particularly dangerous (to humanity).

link
zamadatix 978 days ago
The only way you'll get intelligence is if these models start a permanent training cycle, feeding input and output between them makes a larger model not one computing its data in a new way.
link
pixl97 980 days ago
Humans suck at systems thinking.

A snowflake is harmless. A million of them and you might freeze. And a trillion of them may bury your entire city under an avalanche.

Add in the AI-effect where when we learn how something works it's no longer AI, and eventually we'll get to the point of having super capable 'intelligent' digital systems where a huge portion of the population is in denial of their capabilities.

link
zamadatix 978 days ago
I think we'll get there eventually, and maybe not that long of an eventually in the grand scheme of things. If one wants to bash the potential future handling of AI developments because of this I have no qualms. I only take issue with the idea anything ChatGPT Code in particular is doing is related to those concerns.
link
thfuran 980 days ago
>As the resulting combined system of anything you use a book, search engines, wikis, and forums as part of is unlike the raw source information by itself sure

And the GP was clearly referring to such a system, so insisting that it's just a book seems, charitably, off topic.

link
zamadatix 978 days ago
The point is combining these systems doesn't result in intelligence so such a combined system doesn't either, not that such combined systems are an exception to my point.
link