|
|
|
|
|
by can1357
9 days ago
|
|
The layout, as well as all of the paragraphs are written by me manually, although I generally draft a completely broken English one very rapidly and ask it to paraphrase, I do apologize if the editorial pass made it harder to read, but it really isn't an LLM's opinion :) I thought KV cache not being as important was obvious, as a big part of the benchmrks were focused on pricing, but in retrospect I can see how I could've made that more clear. In the end cost is what matters most and as seen from the results the KV cache miss on the cheap model doesn't really matter as much. |
|