Hacker News new | ask | show | jobs
by enahs-sf 5 days ago
Occam’s razor tells me it’s probably because it’s not good. Perhaps running a company like survivor in a pressure cooker is not an effective management strategy.
2 comments

Also when you finally make it better, the others make theirs even better and you are still behind.
Seemed to work when it comes to selling ads. I'm thinking training LLMs is harder than anthropic and openai make it look
I'm guessing both openai and anthropic have transitioned to prompt magic and fine tuning rather than try to keep building LLMs at scale. The fact that QWEN and other models are impressive, small and perfectly suitable for most work means every dollar you're spending on trying to train larger models is a losing prop.
> every dollar you're spending on trying to train larger models is a losing prop

You probably don’t know how smaller models are trained then. Most of them are knowledge distilled or trained using data generated from larger models. If larger models are stopped there is no magical way smaller models will keep getting better.

you're arguing with capitalism not science or engineering.
Why don’t you argue with science and engineering then?