Hacker News new | ask | show | jobs
by 1970-01-01 31 days ago
Creating a single real-world object and declaring it a benchmark? No, it doesn't work that way for a robust tool. You need to do something like Iron Chef, with a Greek architecture theme and and a panel or judge that declares the winner. This is just seeing which tool subjectively makes the best looking Pantheon.
1 comments

Yeah, this is less of a benchmark and more "I like this one guys!".

Just totally subjective grading criteria of a single poorly defined example with no end use case in mind to guide how to even do evaluation.

It's still interesting in a similar way to Simon Willison's Pelicans on a bicycle.
The Pelicans are mostly just entertainment.