Hacker News new | ask | show | jobs
by charcircuit 849 days ago
LLMs output a probability distribution for the next word. Searching the space of what the best next word to use is takes more time than just picking a good one and assuming that it was a good enough choice.