[thiagoperes]

We run a lot of varied, tiny, simple workflows that were previously running on 5.4-nano and mini. We transitioned them to 5.6 and noticed exactly this range of improvement across the board. In a few cases, we had improvements in classification.

I think a lot of people miss that for many companies, a model upgrade like this is basically a one liner.

Even if you have an amazing model router architecture (which we do for our golden flows), it’s just not worth it. Not to mention reliability and so on

[madaxe_again]

The first thing I used Sol for was to assess 5.6 on our workflows - previously, it was 5.5 for everything, as the quality on simpler models was just not good enough. We’re doing a mix of text and image analysis to extract explicit and implicit structured data from a steaming pile.

They do work pretty much as advertised. The bulk of our workload is now going via terra, which has cut our cost in half by itself, as well as improved response times by 50% - luna I am using as a backstop for opencv hits, and it is good enough, and so cheap as to almost be free - but very limited - and very fast. Sol only gave marginal improvements over terra for our workload.

I’ve also gotta say I’m impressed as to how well Sol ultra carried out the assessment itself - it made sound recommendations, and gave me a nice big dossier of “you should look at these outputs yourself and compare and consider” along with raw and digested data, and cpm for queries.

Anyway. Spent nothing beyond my pro sub, let Sol gnaw on it for a few hours, and my cost basis just dropped 50% and throughput improved by 100%. Win.

[desterothx]

the article is literally about the model upgrade not being a one liner

[febed]

What SDK are you using? Or is it custom?