[intended]

In essence: “You cant know in advance how far the model can approximate semantic patterns”

So claiming that out-of-sample performance is a mirage, would be a bridge too far?

[ethbr1]

Maybe "a mirage that might actually be true"? Which is a terrible thing to rely on! Unless it's usually true?

[intended]

That measurement is the core of my current tasks. If you don’t know the error rate - then what are you doing ?

[ethbr1]

Delivering what some executive promised when they told investors 'the company is using AI.' /s

[intended]

A Virtual beer/poison of choice to you and mjburgess in this thread.