[dozerly]

I’m afraid you’re going to have to start randomizing your benchmarks somehow. I’m sure these models are trained on this problem by now.

[tyre]

If they did, they launched early! If they didn’t, their training data contains a bunch of poorly executed pelicans on bikes by other models.

[tstrimple]

Wait. Based on the results of the test linked above you think this model might have been trained to produce it? Did you look at the results?!

[argee]

That’s the problem. If all (or zero) models were trained on it, it would be fine as a benchmark.

[0-_-0]

It's not a benchmark, it's a meme

[OrangeMusic]

To be fair, the "they're trained on this benchmark" response is also a meme.