Hacker News new | ask | show | jobs
by nightpool 26 days ago
Your comment makes sense but I'm pretty sure yreg is saying the opposite of that—that their task is harder than the benchmark currently is.

(see their follow-up reply: "The cheapest-per-benchmark-task model would be useless to me if it cannot do the task I need.")

In either case, you need the right benchmark for the right task