[michaelhoffman]

The final performance evaluation does not use cross-validation, but uses totally held out validation data not used during model selection.

[nonbel]

Thanks this is not at all clear from the pre-print. From the final paper it does seem you are right, but the datasets and usage probably could be a bit clearer (eg include a table with that info).