[fzysingularity]

FYI one of the models on the battle was pretty slow to load. Are these also being rated on latency or just quality?

[kbyatnal]

Ultimately, there’s some intersection of accuracy x cost x speed that’s ideal, which can be different per use case. We’ll surface all of those metrics shortly so that you can pick the best model for the job along those axes.

[andrewlu0]

ideally we want people to rate based on quality - but i imagine some of the results are biased rn based on loading time

[hdjrudni]

That's an easy fix if you wait for the slowest one and pop them both in at the same time, no?