[teleforce]

The rest of the paragraph explanations are more important.

"The goal to make longer unattended sessions safe enough to be useful without fully removing the human from the loop. It should also reduce the number of low-quality PRs your teammates have to review for details the agent should have caught itself."

>safe enough to be useful without fully removing the human from the loop

This is the fundamental concept for AI usage, assistance and adoption for every fields not only code generation.

Essentially AI including LLM, ML, DL, is just a tool, like any other automation tools operating based on the principle of expert-in-the-loop as safety and quality gatekeeper, for sensible and responsible decision making [1].

[1] Domain expertise has always been the real moat (brethorsting.com) (519 comments):

https://news.ycombinator.com/item?id=48340411

[_zoltan_]

it's fine to remove the human from the loop. set a macro goal, tell the agent how you think it could go there, and let it go nuts.

with enough scaffolding around self-reflectivity and metrics, it will converge.