Hacker News new | ask | show | jobs
by BarryMilo 265 days ago
Isn't the whole problem that it's nigh-impossible to isolate context from input?
1 comments

Yeah, ultimately the LLM is guess_what_could_come_next(document) in a loop with some I/O either doing something with the latest guess or else appending more content to the document from elsewhere.

Any distinctions inside the document involve the land of statistical patterns and weights, rather than hard auditable logic.