[34679]

>If an LLM is often going to be wrong anyway, then being able to try prompts quickly and then iterate on those prompts, could possibly be more valuable than a slow higher quality output.

Before MoE was a thing, I built what I called the Dictator, which was one strong model working with many weaker ones to achieve a similar result as MoE, but all the Dictator ever got was Garbage In, so guess what came out?

[LinXitoW]

Sounds more like a Mixture of Idiots.

[charcircuit]

That doesn't seem similar to MoE at all.

[34679]

Well, I really didn't provide sufficient detail to make that determination either way.

[_kb]

You just need to scale out more. As you approach infinite monkeys, sorry - models, you'll surely get the result you need.

[dingnuts]

why's this guy getting downvoted? SamA says we need a Dyson Sphere made of GPUs surrounding the solar system and people take it seriously but this guy takes a little piss out of that attitude and he's downvoted?

this site is the fucking worst

[kelnos]

Maybe because this site is full of people with differing opinions and stances on things, and react differently to what people say and do?

Not sure who was taking SamA seriously about that; personally I think he's a ridiculous blowhard, and statements like that just reinforce that view for me.

Please don't make generalizations about HN's visitors'/commenters' attitudes on things. They're never generally correct.