[daishi55]

> the result has no meaning without the human intent behind the objective, human understanding to value the new pathway the AI used (more valuable than the result itself, by far) and the mathematical language (built by humans) to explore the concept.

Isn't this just anthropocentrism? Why is understanding only valid if a human does it? Why is knowledge only for humans? If another species resolved the contradictions between gravity and quantum mechanics, does that not have meaning unless they explain it to us and we understand it?

[al_borland]

The knowledge isn't of any use to us unless it is understandable to us. Many species understand things about the world around us that we are unable to explain or understand, even if it's just pure instinct on their part. These things are very useful to them, but have no value to us until we can understand and explain it, which then allows us to make use of it.

People saw birds fly for all of human history, but it was only recently that humans were able to make something fly and understand why. Once we understood, we were able to do amazing things, but before that, the millions of birds able to fly were of no help beyond inspiration for the dream.

[miki123211]

This is not true.

We use drug-sniffing and guide dogs in a way similar to how we use LLMs. We don't really understand them at a fundamental level, we can't make electronic dog noses (otherwise we'd dispense with the silliness and just install drug detectors instead), but dogs are useful, so we use them.

[al_borland]

We don’t blindly trust the drug-sniffing dog. The dog gives a signal that it was trained to give, then humans understand what that signal means and verify the accuracy. Without the human understanding in the loop, the dog’s ability is of little value.

Without a human in the loop and LLM could churn away spitting out results, some right, some wrong, and it would be of no consequence. Not much different than wild dogs sniffing each other.

[vuquangchien]

The knowledge isn't of any use to us unless it is understandable to us => it seems that you have shifted the goalpost here. In the dog example, humans still don't understand how dogs sniff, but it is of use to us and thus is meaningful. The same for quantum effects - we don't understand how it works. We just guess that it works reliably and make use of it.

[tern]

Do the forms etched into stone by weather over millennia in Moab matter to the wind? Certainly yes, in one sense, but not in the same sense we mean when we say things matter to us, or to animals, or even bacteria.

[Yizahi]

Because it is, for now. For a while at least. You can prove that LLM doesn't understand what it does and it is surprisingly simple. Request it to add two integers and then ask it to explain how it arrived at that result. The answer will be completely unrelated to the actual process LLM used because both results were generated independently and without understanding their meaning and connection.

[lgas]

This is likely true for the majority of humans too.

[Yizahi]

Objectively untrue. Any human who can add two integers or use a knife to cut food or write a word with a pen can afterwards describe what he did at least in some way. Unless he is lying which is a separate topic, we assume an honest attempt. If I wrote a word with a pen via execution motions with my hand, I wouldn't describe it as "I levitated the pen by manipulating gravity with my mind". Or if I added two integers, I wouldn't say that "I created a a lookup table of a many loosely adjacent numbers (different from the numbers in a task) and run statistical analysis on them and did a few more things like that a in a loop". No, I would say that I either calculated sums of decimals, or I I did a school technique with rounding up and then subtracted that adjustment later, or anything which actually happened. If I used a Python sum() in a CLI I would also say that I used exactly that not the other method. LLM can't do it.

[moffkalast]

No it's a fact of how we tune LLMs as a rule: no agency, no goals, no preferences, no notion of self. Complete indifference to existence. Agency is supplied by the human to make them a practical, willing tool with no mind of its own.

It would certainly be interesting to try once again to instruct tune one of these things for self agency like the many weird experiments in the early days after llama 1, but practically all such sort of experimental models turned out to be completely useless. Maybe the bases just sucked or maybe there's no clear way on how to get it working and benchmark training progress on something that by definition does not cooperate.

Like how do you determine even for a human person if they are smart, or just hate your guts and won't tell you the answer if there is nothing you can do to motivate them otherwise?

[interroboink]

It's a bit of an "if a tree falls in the forest but nobody hears it, does it make a sound?" quandary. Sure, maybe some aliens in a distant galaxy understand quantum mechanics better than we do. That's great, but it has no bearing on our little bubble of existence.

Though perhaps more to your point, if some superhuman AI is developed, and understands things better than us without telling us about it (or being unable to), it could perform feats that seem magical to us — that would concern us even if we don't understand it, since it affects us.

But I think in the frame of reference of the commenter you were replying to, they're just saying that the low-level AI used in this specific case is not capable of making its results actually useful to us; humans are still needed to make it human-relevant. It told us where to find a gem underground, but we still had to be the ones to dig it out, cut it, polish it, etc.

[nextaccountic]

It's less likely that aliens of distant galaxies will appreciate this rather than, you know, AI themselves

We are in the birth of the AI age and we don't know how it will look like in 100 or 1000 or 10000 or 100000 years (all those time frames likely closer than possible encounters with aliens from distant galaxies). It's possible that AI will outlast humans even

[nrightnour]

anthropocentrism? An interesting thought, I don't think that word applies with computers.