Hacker News new | ask | show | jobs
by lucubratory 1117 days ago
If you have put the answer into the program then by definition you had the test available to you when you finalised the program, which means it is definitionally not a novel test.
1 comments

The test is novel to the program, just not its programmer. So are we testing the program or are we actually testing its programmer? If we're testing the program, then the programmer's foreknowledge is irrelevant.
>The test is novel to the program

That's funny, I thought you said the test's answer was embedded into the program, making it definitionally not novel to the program.

Anyway, this is boring. You've had five or more opportunities to understand what the word "novel" means in an ML testing context and are choosing wilful obtuseness instead.

> in an ML testing context

OP was not speaking in the ML testing context, hence the misunderstanding.