[jaredklewis]

I'm fine with paper tests as a tradeoff, but in the real world where I am paid to program, I am a strong advocate of advanced type checkers/compilers and other static code analysis tools because they can keep all the code "in their head." They can keep far, far more code "in their head" than even the most gifted programming savants. Literally as I type out a mistake, the type checker alerts me to it.

So in some theoretical hiring example, if I have to choose between two candidates: one which is really good at keeping the code in the head and the other who is less good at that, but who is very skilled at using programming tools like advanced type systems or formal verification tools, then I'd prefer the latter.

Of course in practice, I would of course take a student that I knew had passed their paper test with their own knowledge over a student that likely ran their digital test through an LLM.