Hacker News new | ask | show | jobs
by revolvingthrow 12 days ago
According to artificialanalysis, cost per task is $0.94, which is almost the same as $1.04 of gpt 5.6 sol max (fable is most expensive by far, at $2.75). Things like glm 5.2 max cost roughly half that. The model certainly sounds extremely impressive for something not from openai/antrophic, but the price makes it a mediocre product.

Instruction following seems lower than I’d like, too. OTOH scores on agentic stuff seem high, which… feels a bit contradictory? I thought decent instruction following is step 1 of solid agentic workflow.

The benchmarks look nothing short of incredible. Assuming it’s not benchmaxxed to hell and back it’s just a notch below gpt 5.6, which came out what, a week ago? If the performance claims hold up the delayed Gemini 3.5 pro will likely end up not only behind fable, but also behind 5.6 and a (supposed) open weights model. Google might have to do some real soul-searching.

1 comments

so it is ~ same price as openai, same score, but somehow it is mediocre?

edit: not to mention being an open model that you can host yourself

Theres no way you will be able to host it yourself. It’s way too large.
Not for any you. But there exists a you for which you can host it yourself.
But a smallish firm could?
You could host it on Verda clusters for about USD$150/hour