Hacker News new | ask | show | jobs
by hirako2000 17 days ago
You've got to understand, proprietary models operate as the following:

- release: full precision, debrided, uncapped context

- shortly after, hooked: quantized, governance department slammed, and a pseudo large context, attention reduced to start and end of thread.

- down the road: 4bit quantized or worse with nerf incantation to make the next upcoming model feel amazing.

Rince and repeat.

1 comments

They have to be doing some variant of this in the life cycle because of how wildly the performance changes over time. I refuse to give Anthropic my own money because the subscription plans are essentially useless. It's rather nice with a company API account with no spending limit though. But really oAI models are more consistent over time in my experience.