[myself248]

Seems like this process itself should be incredibly amenable to automation. Here's 25 parameters, permute over them, perform this test on each loop.

But it sounds like there were other gremlins (like ulimit reverting itself) that would've thwarted automated testing.

Do you feel like there's a point where it would've made sense to automate?

[hedgehog]

I'm not really sure about that exactly, and the stream-of-Claude text doesn't lend a lot of confidence in the results, but running this with the command line driver wrapped in a scipy.optimize script seems like a faster and cleaner route to an accurate result.

[einsteinx2]

That and I’m not sure why they rebooted the server every time instead of just changing the flags…

[NooneAtAll3]

I think he did employ automation?

it's just that each run takes a long long time