|
|
|
|
|
|
by phillipcarter
838 days ago
|
|
|
Yeah, but latency is still a factor here. Any follow-up question requires re-scanning the whole context, which often takes a long time. IIRC when Google showed their demos for this use case each request took over 1 minute for ~650k tokens. |
|
|