Hacker News new | ask | show | jobs
by stale2002 87 days ago
ok! So if someone uses an existing, checkpointed, open source model then the answer is yes the results are valid and it doesn't matter that the tests are public.
1 comments

Yes, assuming the checkpoint was before the announcement & public availability of the test set.