|
|
|
|
|
|
by karthikeyankc
44 days ago
|
|
|
Blocked? That's atrophy, right? And yeah, token usage as a KPI is a trend I notice across orgs too. Mostly in the 'hypomania' stage where the company is blind to the ROI they're getting out of AI. In saner companies, at least short-term, the human arbitrage should get realised during cooldowns like this. But then again, we're just a few cycles away from better quantization and efficient inference engines. Meaning, relaxed token limits. Also, there's local models getting on par with cloud models. At a point, the quota friction will disappear. The measure will get normalised! That's a hard thing to imagine tbh. |
|
|
Even before AI I noticed this trend. The second someone gets a new tool, they seem helpless without it. The skill atrophy seems almost instant. Even if they have the skill, many people seem unwilling or unable to use it.
> Meaning, relaxed token limits.
I wonder how this will play out. It seems like AI companies are incentivized to make tokens seem rare and valuable, while also encouraging heavy use and tokenmaxxing, to boost revenue. It seems like that will only be challenged when a price war between frontier models, or local models being good enough and cheap/easy enough to make the frontier models seem redundant.