[neom]

A neural net with access to wikipedia is faster than than a neural net that contains Wikipedia? Seems odd to call it AI with a memory though... unless I'm misunderstanding. It's more like AI with a decent memory and an understanding of how to use an encyclopedia.

[robbedpeter]

Yeah, memory implies persisted state in the model, this is static lookups separate from the transformer.

Still superb, though, there's no reason you can't use other gofai tools vs a static database, to trigger expert systems or formalized reasoning.

[visarga]

It's not gofai. It's locality sensitive hashing published in 2008.

[YeGoblynQueenne]

An external knowledge base plugged in to an inference engine? Well, that is 100% pure GOFAI, distilled and bottled, ready to go. Sorry.

[neom]

I got into a very long debate with an openai person 4/5 years ago about this + adversarial learning + access to a quantum computer (think just straight up world class abacus) was close to the primitives required for more generalized AI. They didn't agree with me, but that's ok! :)

[bawolff]

> + access to a quantum computer

Yeah... i think i already agree with the person disagreeing with you just based on this description. "world class abacus" is not an accurate description of what a quantum computer is.

[justinpombrio]

That poor researcher.

[neom]

Thankfully we're very good friends, so it was a few hours well spent over beers (I hope...?)

[saltyfamiliar]

Does anyone know if we understand enough about natural, generally intelligent brains to dismiss the idea that they are using quantum phenomenon for computation? Is it unlikely for any reason?

[edgyquant]

I think people bring up this quantum phenomenon stuff a bit too often in an attempt to add a layer of mysticism to humanity. We should only jump to that conclusion if we have some kind of proof or reason to believe so. We don’t even understand a lot of how the brain works at the macro scale yet so it’s a bit early to start saying it’s dependent on those processes (other than in the same way all physical systems are dependent on quantum phenomena.)

I’m also not a neuroscientist or a physicist though, so this is just my relative layman’s take.

[runnerup]

I believe plenty of "quantum phenomenon" are utilized in humans' biochemistry[0]. Whether the brain "calculates" things using a method that is particularly similar to the methods used in today's quantum computers is...unlikely. It probably is "quantum" in other ways though.

0: https://www.the-scientist.com/infographics/infographic--quan...

[tialaramex]

Yes. It's unavoidably "quantum" in the sense that, as a physical machine in our universe it's subject to the rules, including quantum physics. However there is no apparent mechanism by which "thinking" could harness any interesting properties of quantum physics, it's just not happening at the right scale, like the way kids sand walls on the beach don't alter the world's tides.

[saltyfamiliar]

That proportions in that analogy seem way off. Every single neuron of the human brain could be utilizing quantum mechanical effects at the same time. Not very much at all like a kid's sand castle against the world's tides. I don't think anyone really understand "thinking" and quantum mechanics well enough for the mechanisms to be apparent. I mean, squirrels convert forest detritus into general intelligence. I don't understand the strong certainty against the idea that there's some physics based piece of the puzzle that we're missing.

[dekhn]

Specifically: thinking and creativity do not require the QM phenomena of entanglement, tunnelling, uncertainty, or interference, no matter how much Penrose wants it to be true.

By the butterfly principle, sand walls on the beach do alter the world's tides.

[saltyfamiliar]

Quantum computers don't seem very useful yet, but brains are extremely useful (and they use much less power). Maybe current generation quantum computers would be better if they used quantum mechanics more similarly to the ways our brains use it. The article you linked mentions that entanglement and qubits are being "studied in human consciousness" but I'm not sure what exactly that entails.

[tsimionescu]

Ass far as we understand, out brains use quantum mechanics only as much as our processors use quantum mechanics already - the world is quantum mechanical, so our brains are as well.

However, given the scale of known brain features, the temperature of the brain, and other sources of noise, it's very very very hard to imagine how the brain could be a quantum computer.

[neom]

I had been doing a bunch of research on quantum biology around the time that I had the conversation I mentioned above, that's probably why at the time I wanted to discuss it with him. I think these two lectures are pretty good and I'd watched them around the time I was discussing this stuff with Jack.

Quantum Biology: The Hidden Nature of Nature - https://www.youtube.com/watch?v=ADiql3FG5is

An Introduction to Quantum Biology - with Philip Ball - https://www.youtube.com/watch?v=bLeEsYDlXJk

[frabcus]

Roger Penrose’s The Emperors New Mind proposed this in the 1990s. He gave circumstantial possibilities, and I don’t think we know more than that now.

As an amateur, my instinct is that the mystery of the observer "causing" wave function collapse is the best clue we have either way.

I wouldn’t be surprised if we are just weighted neurons, or if we do something quantum too. I doubt the something quantum will be the same as what our quantum computers do.

[PeterisP]

It's worth noting that it's not the observer causing anything, but a "technical observation" i.e. any interaction with the macroscopic environment; the analogy of "observer" leads to a misleading implication that there's something special if an agent or conscious entity is doing the observation, which it is not.

[visarga]

> Consciousness causing the wave-function to collapse isn't a very popular idea these days and there are alternative explanations, though as far as I know there isn't any evidence that it is involved or if it isn't. The wave function collapse happens regardless of whether a human or any conscious being is present, all that is needed is something does an observation. Imagine a scenario where a QM experiment is done, and the result is recorded by machines and stored as a data file. Let 100 years pass then distribute copies of the file to a million people. They will all see the same thing.

Source https://www.physicsforums.com/threads/does-consciousness-cau...

[neom]

Actually I had just done a bunch of researching on Penrose around the time I was having that conversation with Jack, in fact I think I'd watched these two lectures within a few months of that conversation:

Quantum Biology: The Hidden Nature of Nature - https://www.youtube.com/watch?v=ADiql3FG5is

An Introduction to Quantum Biology - with Philip Ball - https://www.youtube.com/watch?v=bLeEsYDlXJk

[visarga]

Not necessary. Quantum AI is basically explaining something mysterious by something else mysterious, even when there is no indication they are related.

[HPsquared]

Aren't a lot of AI breakthroughs like this though? "It works, but we don't know why"

[visarga]

Good point. But at least we know the ML algorithms are related to ML performance, we don't know that about QM.

[sdenton4]

There's no evidence that "it" is working in the first place, though.

[blurbleblurble]

There's actually a whole field of study that uses tools from quantum information theory to successfully model cognitive and social situations. This doesn't require any assumptions of "quantum physicality". It just makes sense to model probabilistic, reflexive, slippery-to-observe systems with tools that were designed for this. Quantum theory has really great tools and they work well.

I realize this isn't quite the answer you were looking for, but I thought it was worth mentioning.

I personally think this idea that there is some obvious categorical distinction between hard "physical" quantum phenomena and classically probabilistic ones is a fallacy. Quantum theory is in some sense just probability theory with more features.

More and more researchers are catching onto this and I think that's really exciting.

[ummonk]

Surely they'd just use tools from regular information theory and Bayesian inference? Quantum theory is just one particular application of information theory, where uncertainty is directly controlled by physical processes rather than simply due to imperfect knowledge.

[blurbleblurble]

Quantum information comes from Von Neumann entropy, while classical information comes from Shannon entropy. Regardless of where the "source" of information/uncertainty comes from or how "physical" it is, they're related but distinctly different tools which can each be applied to both "physical" or "non-physical" systems at any scale.

"Quantum" is turning out to have very little to do with how tiny or physical stuff is, and much more to do with assumptions about how observations emerge from interaction.

> rather than simply due to imperfect knowledge

That's the key right there... Quantum probability and quantum models don't rely on the existence of "perfect knowledge" or "underlying" objective states. States themselves are intrinsically probabilistic and contextually embedded. Measurements/observations cannot be cleanly decoupled from the states being measured, and are modelled as projections from a high dimensional space of possibilities onto some lower dimensional subspace.

This kinda thing works really well for social/cognitive systems which are incredibly sensitive to measurement process. For example, when conducting polls or surveys, the ordering of the questions is well known to impact the outcome. It turns out that this can be very well modelled using tools from quantum theory, and it has been.

Check out this book and all the books/papers citing it for a window into this fascinating world

https://link.springer.com/book/10.1007/978-3-642-05101-2

[PeterisP]

The quantum phenomena for calculations require strictly limited interactions as otherwise you just get decoherence. Quantum computations inside of our brain cells are unlikely because it's relatively very hot, having random interactions which would disrupt quantum phenomena.

[jowday]

Someone asked this question to Leonard Susskind once at a Q&A and he said the chances are basically zero. When the guy kept pressing on the idea Susskind got kind of exasperated and seemed like he was on the verge of calling the idea woo.

[neom]

I don't think we know enough to know, I also don't think we know enough to rule it out, to me it's plausible, and that was generally the debate... is a quantum requirement there or not. Also as a note, this was conversation over beers with a buddy, so it wasn't HN scrutiny standard, we were getting philosophical. (I know very little about the subject so my opinions aren't much more than "fun ideas".)

[dekhn]

nobody needs to "dismiss the idea", the null hypothesis is that brains don't exploit quantum phenomena. In the absence of any reason for them doing so, and the lack of evidence that the do so, the onus is on the quantum brain folks to come up with better falsifiable theories.

[bawolff]

Even if they were (big if without really any evidence), we have no idea how, so adding a quantum computer to the mix won't get us any closer to general AI.

It would be like adding a classical computer we don't know how to turn on; it won't help anything if we don't know how to use it.

[machiaweliczny]

We will only know if we can't built it.

My gut feeling is that even if we use some probabilistic quantum compute it should be transferable to normal compute. Also animals vs human don't have enough difference to assume we are special.

[torbTurret]

What’s your argument?

[neom]

I hope I didn't come off like I think know anything about this field, because I don't. A friend who use to work for openai (Jack Clark) and I spend some time once discussing over beers some stuff around general purpose AI, and I proposed that I believe quantum is a dark horse on the road to general purpose AI, and he disagreed.

[netizen-936824]

I think the person you're replying to is asking for your specific argument. As in what exactly do you think is the advantage gained by quantum computing and why is it important.

[torbTurret]

Yeah I have no horse in this race, just curious of your viewpoint as someone who works in the field!

[stavros]

Sounds like a fun debate to me.

[ummonk]

Yeah he's right, you're wrong.

[LoveMortuus]

I wonder what we can learn from AI models about how humans work.

Like, could we assume that for humans it's also faster to search for information on Wikipedia or would it be faster to recall from memory of already read Wikipedia? Although with humans stored information decay is present. (In a way a human form of garbage collection :P).