[bob_theslob646]

Why 40kb?

[egberts1]

Cheap public offering of their expensive data center is that sweet spot and cutoff at 40KB.

[igravious]

and doesn't it depend on the LLM?

[egberts1]

If you have your Pro or private LLM, then it's a tad bit bigger.