[hackingonempty]

Is it not a conflict of interest for a model provider to supply the harness? They are not motivated to minimize your costs.

[robbie-c]

They sort of are, in that they want subscription users to have clients that behave well with the KV cache etc.

If you don't use a subscription, and pay per token instead, you can easily move to another harness.