[anuarsh]

Absolutely, there are tons of cases where interactive experience is not required, but ability to process large context to get insights.

[attogram]

It would be interesting to see some benchmarks of this vs, for example, Ollama running localy with no timeout