[Zetaphor]

There's a lot of valuable things that can be done in that range, especially when token costs aren't a concern. Not every problem requires SOTA

[Aurornis]

> especially when token costs aren't a concern. Not every problem requires SOTA

If token costs aren’t a concern I’m using SOTA for everything.

Even SOTA gets it wrong and hallucinates, but at a lower rate. I don’t want to waste my time.

[lixquid]

I believe they mean token costs aren't a concern when you're not paying for a SOTA model via API, and are instead running local models.

Infinite monkeys on infinite typewriters, and all that.

[Zetaphor]

Correct, I have local hardware, not infinite money.