[tyingq]

The "Shadow predictions" bit is interesting. They could set that up in a way to score it versus actuals...where the shadow implementation automatically becomes the live one once it's better than the incumbent.