Hacker News new | ask | show | jobs
by whynotminot 541 days ago
“Objective benchmarks are useless, let’s argue about which one works better for me personally.”
2 comments

Yes. My benchmarks and their benchmarks means AGI. Their benchmarks only means over-fitted.
Ok so what if we get different results for our own personal benchmarks/use cases.

(See why objective benchmarks exist?)

Yes, "objective" benchmarks can be gamed, real-life tasks cannot.