[cyanydeez]

I'm guessing both openai and anthropic have transitioned to prompt magic and fine tuning rather than try to keep building LLMs at scale. The fact that QWEN and other models are impressive, small and perfectly suitable for most work means every dollar you're spending on trying to train larger models is a losing prop.

[vinni2]

> every dollar you're spending on trying to train larger models is a losing prop

You probably don’t know how smaller models are trained then. Most of them are knowledge distilled or trained using data generated from larger models. If larger models are stopped there is no magical way smaller models will keep getting better.

[cyanydeez]

you're arguing with capitalism not science or engineering.

[vinni2]

Why don’t you argue with science and engineering then?