Hacker News new | ask | show | jobs
by throw310822 21 days ago
> We know how these machines work, it's not mysterious, there's nothing "extra" happening.

Lol. This is more telling about your implicit unscientific preconceptions that you wanted to reveal. Of course there isn't anything "extra". Where do you think intelligence comes from, some mysterious realm? It's physical, computational. The fact that at the bottom we produced it via matrix multiplication is irrelevant. Maybe humbling. You are denying a visible fact (a machine performs tasks that require flexible analytical and cognitive skills) precisely because there is no magic happening anywhere.
1 comments
27183 21 days ago
> Where do you think intelligence comes from, some mysterious realm? It's physical, computational.

Well, no. I don't think it comes from some mysterious realm. I think that which is not physical does not exist [edit: and if you like I'll follow that one right down the rabbit hole--continuity and infinity are useful delusions]. But that eminently does not mean we know what intelligence is, let alone how to build one.

> The fact that at the bottom we produced it via matrix multiplication is irrelevant.

Huh? We don't even know what "it" is. How can you say you produced it?

> a machine performs tasks that require flexible analytical and cognitive skills

You see that, I see a lucky stochastic search result. Don't underestimate the "creativity" of random algorithms! They can do some wild shit! This is nothing new, we've been playing with these toys for like 70 fucking years. It's only recently that they started spewing words and everyone lost their minds over it.

link
throw310822 21 days ago
You do realise then that "we know how it works, there is no "extra" there" is an argument that can be used against any artificial intelligence, now or in a thousand years, as well as (at some level) against human intelligence (no magic, it's all physics, just dumb cells exchanging signals). This should be enough to give you pause- you immediately reached for an argument that is entirely empty.

> I see a lucky stochastic search result

Again you're reaching for a mechanistic explanation of some kind (let's leave for the moment whether it makes sense or not) as if having an explanation somehow contradicted a display of intelligence. It doesn't. Yes of course we made it, we know how it works (ar some level) and there is no magic. But what matters is the result- this machine, matrix multiplier, stochastic parrot, consistently displays intelligence, to the point of being able to perform very complex, open-ended tasks that integrate discovery, planning, tool usage, decision and even some aesthetic sense, understanding and using natural language, context awareness, you name it.

> This is nothing new, we've been playing with these toys for like 70 fucking years

Lol no. For god's sake. Hundreds of billions of parameters organised in a specific architecture and trained with unimaginable amounts of data and compute? Unless by "these toys" you mean "any computer program vaguely AI-related".

link
27183 21 days ago
> But what matters is the result- this machine, matrix multiplier, stochastic parrot, consistently displays intelligence, to the point of being able to perform very complex, open-ended tasks that integrate discovery, planning, tool usage, decision and even some aesthetic sense, understanding and using natural language, context awareness, you name it.

IDK, it doesn't seem like they actually do any of that. To me it seems like they have good enough semantic embeddings that they can kind of approximate those things, sometimes, well enough if you don't look too hard. This is enough to fool people. Of course there's gold in them hills--some recent mathematical results were found there. But to say that's "intellgence" is to say that lossy compression is intelligence. It's static. It does not learn. It does not adapt.

> Unless by "these toys" you mean "any computer program vaguely AI-related".

Not "vaguely AI related". I mean stochastic computer programs that can do things that look awful thinky. They've existed for a long time, but only recently (due to word2vec and other advances) have the results been words that mostly go together well instead of numbers. For some reason people seem to think a lot less critically when the output is words. IDGI but it's a whole thing.

link