Hacker News new | ask | show | jobs
by seddonm1 127 days ago
My test harness loads up the original DLL then executes that in parallel against the converted code (differential testing). That closes the feedback loop the LLM needs to be able to find and fix discrepancies.

I'm also doing this on an old Win32 DLL so the task is probably much easier than a lot of code bases.
1 comments
measurablefunc 127 days ago
What are you tracking during the runtime tracing? Or is that written up in your link?
link
seddonm1 127 days ago
I am applying differential/property based testing to all the side effects of functions (mutations) and return values. The rust code coverage is also used to steer the LLM as it finds discrepancies in side effects.

It is written up in my link - please bear in mind it is really hard to find the right level to communicate this level of detail at - so I'm happy to answer questions.

link
measurablefunc 127 days ago
That's fine, that answers my question.
link