[acuozzo]

If your AI uses a classical computer, then everything it's doing is reducible to the Boolean algebra of its component logic gates.

All of the training you've done on the GPU; all of the coordination done by the CPU; everything… it's all one (absurdly long) boolean expression.

Like all algebraic structures, Boolean algebra is built from an initial set of axioms. Under Gödel's incompleteness theorem, it is therefore true that if Boolean algebra isn't inherently broken (inconsistent), then we can craft questions that cannot be answered using Boolean algebra alone, but this is all your classical computer is capable of doing!

Now, if you're training AI using an analog system or a non-classical computer such as a quantum computer, then this opens up a totally different discussion.

[visarga]

> we can craft questions that cannot be answered using Boolean algebra alone

Sure, that's trivial, the travelling salesman problem for example can't be solved exactly, but approximative methods come very close. Given that brains are pattern recognition machines generating probabilities we're already in the approximative regime. Nothing is certain, even science has its revisions.

So does it matter if we can only approximate? For living things the main thing that matters is life, self reproduction, not exactness. As long as they reproduce they are still valid, with all imperfections and approximations. I think the only questions that matter are those related to life, there are plenty of uncomputable things outside self reproduction. This is for biological agents, an AI would be using evolutionary methods to reproduce their digital genes instead.

[SuchAnonMuchWow]

The traveling salesman problem can absolutely be solved exactly. It just takes a lot of time.

Computability doesn't take into account how fast you can solve a problem: only if it is possible to solve it at all.

[visarga]

It's exponential, you can solve it for N=100, but not for N=1,000,000. You can't say "it just takes a lot of time" if that time is > age of the universe.

[herbstein]

Actually, you can. There's a huge gulf between things that we know we could compute given enough time, even if that time is impossible to actually be given, and things we know can never be computed given infinite computing power.

Something like the perfect security of either hiding or binding in a commitment protocol can never be broken given computers of infinite capacity and speed because it's mathematically impossible. That is opposed to computational security, which only states that the property can't be broken within any usable time frame. This is often in the order of hundreds of millions of years in practical cryptographic systems. The point is, it can be technically be done.

Breaking RSA can factored just by brute forcing. It might take a lot of time, but actually doing it is not hard for sufficiently small keys. We just increase the key size until it takes a long time.

[acuozzo]

> You can't say "it just takes a lot of time" if that time is > age of the universe.

1. The difference matters a WHOLE LOT when you're studying computability. If the question you're trying to answer is "Can this be computed exactly?", then the distinction is paramount.

2. Your argument here is functionally equivalent to stating that there exists a largest number since it's trivial to construct a number which would require more digits (in any base you'd like) than subatomic particles in the entire universe to represent in its fully-expanded form… so let's pick this one as the largest and stop worrying about all of that infinity hub-bub!

[SuchAnonMuchWow]

There is a fundamental difference between "We don't know how to solve this practically since the best solution we have would take too much time." and "It is a problem without solution. It can not be solved at all not matter how you approach it, or even how an imaginary alien specie with technology beyond our understanding would approach it".

Also, the equivalence between the different models of computation for Turing completeness (turing machine, lambda calculus, ...) isn't about complexity classes of the problems, only wether or not the model allow to solve the same set of problems. For example searching in a sorted array is O(log n) on a Von Neumann machine but O(n) on a Turing machine.

[chakhs]

Isn't his theorem proving that any mathematical system will be either incomplete or inconsistent ? And quantum computing is still a mathematical system so the same applies ?

[acuozzo]

Yes, but I didn't cite QC as an exception to the rule. I only mentioned it because it's governed by a different set of axioms and would result in a different discussion.

[ProfHewitt]

Computer systems make extensive use of arbiters in addition to Boolean circuits.

See the following:

https://papers.ssrn.com/abstract=3459566

[acuozzo]

Interesting! Thank you! :-)