[alanbernstein]

Neat, as a reader, I've absolutely wanted this exact behavior many times. Do you have any examples of incorrectly classified images? As you say, the model seems quite simple, but I wonder if there are some pathological kinds of photographs that result in inversion.

[mattismegevand]

Some graphs with lots of colors can be difficult for models to handle. In these cases, the model often chooses not to flip the graph to avoid making it hard to read, based on past problems with similar graphs. The model generally does a good job at deciding when to flip something. Although I haven't seen it flip photos, it's possible that there are examples out there.

[gwern]

Some recently-added datapoints I think the current model mis-classifies:

https://upload.wikimedia.org/wikipedia/commons/thumb/6/69/Pr... https://upload.wikimedia.org/wikipedia/commons/thumb/f/f7/US... https://upload.wikimedia.org/wikipedia/commons/thumb/d/d4/Na... https://upload.wikimedia.org/wikipedia/commons/thumb/b/bb/Li... https://upload.wikimedia.org/wikipedia/commons/thumb/a/a7/Pi...