How about leveraging llms to produce deterministic codemods? You can then iterate on this by running the codemods and using other deterministic guardrails, feeding the results back into the llm to improve the codemods?
Yeah exactly this is right. In the same way that we don't get an LLM to write the HTML for each request, but we do get an LLM to write the code to make the HTML