Hacker News new | ask | show | jobs
by sublee 246 days ago
Incremental JSON parsing is key for LLM apps, but safe progressive UIs also need to track incompleteness and per-chunk diffs. LangDiff [1] would help with that.

[1]: https://github.com/globalaiplatform/langdiff/tree/main/ts
1 comments
cozzyd 246 days ago
Why not just chunk the json packets instead?
link