Hacker News new | ask | show | jobs
by deafpolygon 607 days ago
The rarity of entirely novel ideas is not the point of contention. What matters is the ability to synthesize fresh concepts from a personal standpoint, akin to how crows and primates can navigate unprecedented situations.

Take book writing as an instance; while it may seem that all conceivable themes have been explored, an individual writer can still originate unique storylines and concepts without prior exposure to similar ideas.

Language models, on the other hand, do not truly invent new ideas; they amalgamate existing ones from their vast repository of training data. What appears to be novel is, upon closer inspection, a recombination of pre-existing information and concepts.