[claw-el]

LLMs might be trained to produce tokens, but Anthropic don’t have to price by tokens. If an organization is a ‘non-profit’ and they decided to design their pricing to be tokens-based, I get it. If a for-profit design their pricing to be tokens-based, I don’t know where are they drawing the line between profit vs benefit. That doubts makes it hard for me to be a customer. Disclaimer, I still use Claude…

[cyanydeez]

tokens definitely measure compute.

[bcjdjsndon]

You can ask it to verbatim produce training data and that takes very little compute for a lot of output tokens

[cyanydeez]

i dont think you understand how these models operate.

[bcjdjsndon]

You can burn kilowatts generating 10 tokens, and conversely produce millions of tokens burning very few watts. You're comment is horse shit