|
I have a theory that everything is search. Protein folding? Search for minimal energy. DNA evolution - search for ecological niche fit. Cognition? attention is search, memory is search, imagination is also search, problem solving - of course is search. Scientific progress? It is (re)search. Optimizing an AI model? Search for optimal parameters to fit the data. Reinforcement learning? Search for optimal behavior to maximize rewards. Even speaking is search - we output words in sequence, searching the next word like LLMs. Now I can add comedy to the list. <rant>Search is a nice concept, it defines everything clearly - search space, goal space, action space. Compare it with fuzzy concepts like understanding, intelligence and consciousness. We can never define them, precisely because they gloss over their input-output domains and try to present a distributed process as centralized in the brain. Search has a bunch of properties - it is compositional, hierarchical, recurrent (iterative in time) and recursive. This pattern holds across many fields, I think it is based on the fundamental properties of space-time which are also compositional, hierarchical and recurrent (object state at time t+1 depends on its state at time t) Search can be personal, inter-personal, physical or information based. It can explain away much of the mystery of the three fuzzy concepts I mentioned. I describe cognition as two search loops - search externally by applying known behavior to collect experience, and search internally to compress experience and update behavior.</> |