Hacker News new | ask | show | jobs
by crvdgc 1 day ago
For the sake of argument, let's assume everything in the post is agreed upon, does this mean

1. They'll open source the alignment technology? For open weight models, it's the only possible way to pass the safety without an external guardrail triggering system (which would be the same to open and closed weight models).

2. They'll allow others (including CCP) to define part of the safety test? Otherwise, I can't imagine how the CCP would be onboard.

3. A "western" model passing the safety test can be trained with distillation? Or is that a "distillation attack" as well?

1 comments

On point 2 he talks about it being an area for them to collaborate on. I’d imagine he would be OK with them having input on the bio risk part but maybe not the “did Tianamen square happen” part of the test