|
We're hosting a boxing-style debate in San Francisco on May 5th between Łukasz Kaiser, co-author of "Attention Is All You Need", and researchers building post-transformer models. I'm the CEO of Pathway and co-author of the Dragon Hatchling (BDH), our post-transformer architecture. We're organizing this to bring key researchers on both sides to debate each other without any BS. We invited Łukasz specifically because he can push back on the post-transformer thesis harder than almost anyone. Confirmed so far: - Łukasz Kaiser, co-created Transformer, ChatGPT, o1, o3, TensorFlow
- Mathias Lechner, Co-founder/CTO of Liquid AI, co-created liquid neural networks (MIT CSAIL)
- Adrian Kosowski, CSO of Pathway, created BDH (ex Inria, École Polytechnique) Moderated by me, Zuzanna Stamirowska, and Dex Horthy. Tuesday, May 5, 5 to 8 PM PDT. San Francisco. Goal: Debate upfront without panel pleasantries. Answer core questions like: what the Transformer got right, if and how it's hitting limits on long-horizon reasoning and memory, and whether the alternatives like liquid networks, world models, and BDH can solve these limitations to define the next frontier. Additional context: WSJ predicted AI will outgrow LLMs in 2026, while mentioning the post-transformer research by Pathway and the world models from Yann LeCun and Fei-Fei Li as defining shifts for the year. This debate builds on it along with BDH's recent result on hard constrained problems (97.4% accuracy on Sudoku for a language model) |