Hacker News new | ask | show | jobs
by TimurSadekov 895 days ago
One of the world's leading experts on information security systems, Professor Ross Anderson of Cambridge University, in his article https://arxiv.org/abs/2305.17493v2 is already considering a scenario where most of the Internet will be a neural network-generated hallucination. But neither you, nor me, nor any expert or anyone at all will be able to distinguish between fake and real. As a result, neural networks will degenerate in the process of learning from their own hallucinations of the Internet, and humans will degenerate in the process of applying the degenerated neural networks. This process he called "neural network collapse". It can only be countered by a collective neural network of all the minds of humanity. For mutual validation and self-improvement of LLM and humans, we need the ability to match the knowledge of artificial intelligence with collective intelligence. This is what can get us out of the personal reality tunnels and personal information bubbles in which we are getting deeper and deeper stuck individually.

This network of real human knowledge provides a way to introduce new, clean, human-generated datasets into LLM training in a validity-conscious manner, and makes it possible to avoid model collapse and reduce unwanted errors in creating new and better generations of generative models. And we have a practical solution to avoid the collapse of large language models — we create a global unbiased decentralized CyberPravda (dot) com platform for disputes, for analyzing the reliability of information and assessing the reputation of its authors, where people are accountable with personal reputation for their knowledge and arguments.