[nullc]

I've got a shim that will ask the model to write a summary of what didn't work, then rolls it rolls back the context to before those attempts with only the summary as advice. Some care has to be taken with cache management that there is an available checkpoint back there.

Appears to help, but I suspect it would be much better with first class support and reinforcement learning to make good use of this kind of advice.

Still certainly needs some tuning because I've noticed the model taking the advice as the word of god and avoiding trying anything remotely like the things that didn't work.