|
|
|
|
|
|
by cyanydeez
8 hours ago
|
|
|
Its inexpensive to reserve KV cache for the first turn and would benefit users, given the first turn already requires costly locating and allocating a model slot for a user. So yeah, when they banned tgird party harnesses there was a technical and $ case to have. |
|
|