Hacker News new | ask | show | jobs
by cmxch 9 days ago
That’s fine as long as I can identify and reject any Mythos derived patch as being irreproducible.
2 comments

Why would it not be reproducible?
Its analysis from prompt/harness to end products.
You can't do that for me either.

Why would you refuse to use a patch that deals with a valid PoC exploit?

If a random contributor posted an explanation of an exploit, showed it worked in an executable way, presented a patch and you could see that the exploit no longer worked - would you refuse to use the fix until the contributor showed how they figured it out?

Given where Mythos alleges to go, reproducibility far beyond a hash promise, an alleged (but not really proven) existence of an PoC, and “Trust me bro” is necessary.

When an ungated (or even abliterated) public model can repeatedly, easily, and accurately embarrass Anthropic’s models, that might change.

How can a patch be "reproducible"? The testcases are reproducible.
How Mythos’s mysterymeat got there from front to back.