[antonvs]

You're assuming a perfect system in which all relevant properties are tested for. That doesn't match probably 99.9% of real world systems.

The issue with AIs reverse engineering code is that context is very important - in fact knowledge and understanding of the context is one of the few things humans can still bring to the table.

Unless every relevant fact about that context has been encoded in a recoverable way the system and tests, AIs can only do so much. And there are essentially no non-trivial systems where that's the case.

[9rx]

You would test all important properties. That matches all real world systems you are responsible for. There is no reason to accept a lower standard for yourself.

Absolutely you have no control over what others have written, but you also have no way to access their lost context, so you are no further ahead than an LLM in that situation. The available information is the same for you as any other system.