| You're assuming the phrase "a sufficiently advanced AI" answers anything at all. Presumably you're assuming if the information is there at all - if the necessary data hasn't been scrambled beyond the noise floor of the scrambling process - then there's something for magic (because you're really talking about magic here) to work with. So, please (a) set out your claim with precision (b) back up your claim. * What is the information you need to recover? * To what degree is it scrambled? * What of it is scrambled below the noise floor of the process? * How do you know all this? (wrong answer: "here's a LessWrong/Alcor page." right answer: "here's something from a relevant neuroscientist.") For comparison: even a nigh-magical superintelligent AI can't recover an ice sculpture from the bucket of water it's melted into. It is in fact possible to just lose information. So, since you're making this claim, I'd like you to quantify just what you think the damage actually is. |
In that sense, 'a sufficiently advanced AI' is not magic, because when people say that they definitively have something in mind, at least the people I often discuss this with do.
In short: if you're smart(fast, precise, determined) enough to look at the individual molecules of a puddle of brain-goo. And if you can infer the way it has collapsed by ray tracing those molecules back through how they collided with each other/the walls of your mold then it should be possible to reconstruct the spatial form of the brains at least. That's a pretty big IF obviously, but equally obviously not impossible. If only you can look deep/far/fast enough.
If you want to be theoretical about it, then yes. There is probably an upper bound on how smart/big an AI mind can possibly be. And thus there is a limit on how much information it can extract from arbitrary systems. So I agree with your assertion that there is information that even the smartest of all AIs cannot possibly reconstruct, but I'm not sure that the brain is such a structure.
Any justification about why/how 'a sufficiently advanced AI' could come about is more questionable.
Many knowledgeable people are making guesses based on our current understanding of intelligence/computation/AI, and then extrapolating. The paradoxical thing is that on the one hand AI-doomsday speakers tell us no to anthropomorphise (for good reasons) with the motives of an AI, but on the other hand apply human reasoning/understanding to predict such machines/patterns.