[esafak]

This is fine for historians, if any are studying this. What practitioners need is help in picking a model. For a given task, what are the best models, and what are their trade-offs?

If there were a database of model benchmarks, type of task represented by the benchmark, dataset used, and other salient features like number of parameters, etc. life would be easier.

If none exists, and one were motivated to create one, what's the best place to crowdsource a relational database?

[whimsicalism]

paperswithcode

[esafak]

TIL that site does more than share code! Here are relevant entries for this post:

https://paperswithcode.com/methods/category/transformers

https://paperswithcode.com/paper/harnessing-the-power-of-llm...