Hacker News new | ask | show | jobs
by storus 7 days ago
> “speak the language” of the concepts the LLMs have produced

LLMs don't produce concepts, they just predict next tokens; they can't invent new concepts, only synthesize what is in their probability distribution already. They can mix/fuse vast areas of math together that are inaccessible to individual mathematicians, but can't create new concepts not present in their probability distribution.