|
|
|
|
|
by aspenmartin
27 days ago
|
|
This makes sense but I am not comfortable with the open source picture either. It depends on the use case and long term strategy. If you're handling customer support tickets or something, beyond some capability I can't imagine the ROI would be worth needing the absolute frontier. You are then in a wonderfully lovely place: absolutely full control over the model and inference stack (if you want). But - Plenty of businesses are stuck between a rock and a hard place: make 3p models load bearing, or sacrifice performance to the competitors that are willing to swallow that risk - I just cannot imagine a viable equilibrium where OSS models compete on capabilities with the frontier without a hidden payer and shaky economics. Quant funds, some sovereign AI effort, cloud business, sanctioned distilled frontier models; all of these are demonstrably viable vehicles for OSS development. But the optimal position for these purposes is not to be the best, it's to be good enough (which I think is the position they find themselves in). I can imagine temporary points where open models pull ahead but not sustainably. I agree there are many many use cases where the optimal choice is to reach for open weight models (I assume yours is one of them). But the economics of frontier model development necessitates that these models are behind and thats a problem for other cases. |
|
1. All intelligence has value. A Harvard MBA or Stanford CS engineer have value. Haiku has value, Opus has value.
2. Sometimes it makes sense to buy, build or rent capabilities. But lack of ownership of something your business requires to operate is an existential risk which requires ownership.
3. Current OSS models are good enough for substantial automation and productivity gains with the right orchestration and harness. Especially with domain experts in the loop.
4. Frontier models while better, introduce existential risk; so they are a temptation that should be ignored if you care about your business being able to continue to exist.
Let’s invert this conclusion. Imagine you build a workflow around Fable 5 and the workflow going down would harm your business. Well the government has demonstrated ability and willingness to impose a multi day / week / month interruption in your business with no legally required notice, right to appeal or compensation. And further demonstrates a willingness to give preferential access to your competitors.
For these reasons, the only viable path is a model you have on servers you control and can replace if needed. That means cloud providers are fine if you have the model archived somewhere.