[dools]

It’s not meaningless at all: every query returns usage and I can calculate the cost.

EDIT: this is like saying hourly rate or salary is meaningless. Different people have different output. You have to evaluate performance.

EDIT2: just pray the LLM providers don’t start taking Patrick McKenzie’s advice and start charging based on “value delivered”

[ttoinou]

Can you really calculate the cost easily ? Given most of it should be reduced by input caching read (if you don’t want to have a crazy bill)

[dools]

Yeah you get the usage back and each element has pricing published