Hacker News new | ask | show | jobs
by paxys 1173 days ago
The measure of a "good" model is still very subjective. OpenAI has used stuff like standardized test scores to compare the latest iterations of GPT, but that is only one of the many possible objective measures and might not be relevant in a lot of cases. Maybe we'll come to a consensus around such a methodology soon, or maybe it'll be something every user has to judge on their own depending on their goals.
1 comments

It's even harder to measure when what you value are subjective things like creativity.