Distills are bad for the US economy because they compress margins that otherwise go to pushing the frontier. You'd see model progress dramatically slowed if US companies had to compete on distills.
> You'd see model progress dramatically slowed if US companies had to compete on distills
We’re already competing on distills—they exist. The question is whether America will actually compete or if it will lean into its populist tendency and cede the market globally to China.
Yeah, I don’t buy this is happening. I’m open to being wrong. But folks who believe that can put their money where their mouths are in terms for stumping up cash for the training.
> distills force you to move your compute off the frontier
I guess I don't know how you can use the latest models and feel that we are not on the verge of some kind of intelligence. Maybe it's your harness, maybe your problems aren't complicated enough. I find it bizarre to outright dismiss the possibility of AGI in this day and age.
Almost certainly not in the long term. If AI is a productivity enhancer, which I think we have evidence for, then the American economy’s heft (and continuing dynamism) get a tailwind. The minority of the new, leveraged economy getting hit will be a short-term painful adjustment, but it need not be anything more.
The distills are almost certainly bad for the US economy.
AIs promise is undercutting knowledge work, which is our primary export. Manufacturing left ages ago.
In theory, if OpenAI/Anthropic win then the US still wins since they’re headquartered here.
If open or Chinese models succeed, it undercuts our knowledge work market and that money starts flowing out to inference providers instead of in to US companies and their employees.
We do, we export almost twice the amount of goods. The margins on services are so much better that the majority of the profit from exports is from services. I can’t find a study that has traced export revenue to export profit, but the services sector floats around 50% margins and manufacturing is around 15%. That would ballpark goods export profit around $30B and services around $50B.
> America is the second-largest manufacturer in the world by a long shot.
America is the third most populous country in the world. Normalize by population and we’re pretty middling; America is 53rd in merchandise exports per capita (63rd in overall exports per capita). South Korea exports over double our manufacturing per capita.
> Where are most of these?
The most companies, or where the most tokens are going? If you mean “where are the most tokens going?” it’s probably not the US.
The best data I can think of is OpenRouters usage leaderboards, which probably don’t include enterprise customers, and that’s dire.
You don’t hit a US model until #7 and it’s Nemotron which Nvidia is serving for free. The first US model that actually charges is Opus 4.8 at #9 and it handles about a sixth the traffic of the top model (Mimo-V2.5).
There’s really not a ton keeping inference in the US on a moderate time horizon imo. Tencent has Hy3 up for free right now, all Chinese inference, and it’s doing double the tokens Nemotron and Opus 4.8 are doing combined. For free, via the API.
It might not be China, but their aggressive investments in power generation and green energy make it seem likely. They just need GPUs and they seem to be nearing the point where they can offer them based on the Hy3 inference.
The longer the US AI strategy continues to be to bet on openai/anthropic the bigger it will be the US economy impact. The US bounced back from the dotcom crash and the 2008 crash, it does not mean it will bounce back after an AI crash.
We’re already competing on distills—they exist. The question is whether America will actually compete or if it will lean into its populist tendency and cede the market globally to China.