Hacker News new | ask | show | jobs
by waffletower 31 days ago
"An LLM predicts the next word based on all the words before it. That is the whole story. There is no idea sitting underneath." At most, and I will argue for less, that is half the story. This egregious over-simplification doesn't account for training and the massive dimensional space of thought it forms. Given that frontier models likely have trillions of parameters, the combinatorial space of ideas within approaches the infinite -- hardly zero.