Hacker News new | ask | show | jobs
by barefootford 101 days ago
How long does it take to run this? How much is automated vs manual evals?
1 comments
mateianghel 101 days ago
20-30 mins and 10-20 dollars. It's fully automated evals with Gemini 3 Flash as a judge, but I verified manually a lot of them and it grades the outputs reliably.
link