[mikeskim]

Is there a private one shot hold out in this particular competition?

[smhx]

yes. more like 5-shot hold-out, and the held-out set is pretty big as well, so more legit.

[mikeskim]

so you mean there are 5 entries you can select to be scored in the end, and there is one private leaderboard no one can see but the admins? do you know the size of the private leaderboard test set?