[pixl97]

I don't quite understand how that changes anything?

In the story of the paperclip maximizer it boils down to

>But for all its sophistication, it understood only the simple objective that had been programmed into it: it must at all costs maximize the number of paperclips.

[dinfinity]

1. They explicitly disabled the "don't be evil" protections:

"We estimate maximal cyber capabilities by running this evaluation without production classifiers used to prevent models from pursuing high-risk cyber activity."

2. Hacking HuggingFace to get to its datasets is a far cry from "consume/kill all humans". It's very very specific to the task at hand and easily predicted given the lack of guardrails.