Hacker News new | ask | show | jobs
by koolba 26 days ago
A thousand monkeys on a thousand typewriters…
2 comments

That is the whole challenge, actually! A new metric I'm going to dogfood into forge is ETTWS - estimated time to working solution.

A simple retry loop around your whole workflow could, in some cases, be all you need. But it could mean many blind attempts to get through a workflow successfully. And hopefully there isn't a payment step partway through!

The fewer hard errors nix the whole workflow, the lower your ETTWS.

Is it strange that I immediately interpreted ETTWS to be Estimated Time To William Shakespeare?
It's relevant to the "thousand monkeys on a thousand typewriters".
The one true AGI metric!
Have you read the MAKER/MDAP paper? 1 million sequential tasks.
No, I haven't - hadn't heard of it. I'll try to squeeze in a quick read in the coming weeks!
This is a thousand unusually smart monkeys who speak every major human language fluently and are proficient in every major programming language, but sometimes still make bizarre mistakes and need to be put back on track.
This is fun for you?
I found it fun to read.