Hacker News new | ask | show | jobs
by adriancooney 84 days ago
What's the error rate of the pen guy?

Also, if your AI has a 20% error rate, you're not holding it right. You need to spend more time keeping it on rails - unit tests, integration tests, e2e tests, local dev + browser use, preview deployments, staging environments, phased rollouts, AI PR reviews, rolling releases. The error rate will be much closer to 0%.
1 comments
davebren 84 days ago
How does a phased rollout improve LLM error rates exactly?
link
adriancooney 84 days ago
Error rate here is the rate of shipping bugs to customers.
link
davebren 84 days ago
That wasn't what the comment you responded to was referring to. I guess it makes sense since you are kind of like an LLM with how you respond to input.
link