| SENTIENT wasn't doing the same kind of inference that AI companies have now, so suggesting they have nothing new to offer is incorrect. Advanced AI is clearly dual-use technology that can be used for adversarial or defensive purposes in ways most people simply aren't used to thinking about. Your lack of imagination is not proof of reality. The US releases open source models too. The primary concern is that there should be some limitations on the capability of models released publicly. When companies are hosting their models via API, they can have many other layers involved in serving those requests that can reduce abuse. When you release an open model, there is no layer and many protections built into the model itself can often be worked around. China puts more restrictions on models domestically than they do internationally. They did the same thing with Tiktok, where their domestic version was more cleaned up, curated and censored. There, you can't download a model without basically sharing your identity. Huggingface is banned. It would also be illegal there to host the open weight models on a 3rd party inference provider. Kimi? Qwen? If it's not small enough that you can run it locally then you have to use it via API, which are all highly censored. Even the smaller models are censored, it's not only bigger models. The experience people can have outside of China with those models is not the same, but the point is that this directly refutes your suggestion that China doesn't think they are a threat. China would love to maximize the abuse of open models in the west, because there are theories that it leads to more extreme authoritarian surveillance tendencies which benefits their Leninist world view. There is also the perspective that it can hurt investment into AI if people think it's inevitable that equivalent models will be open. > China's hosting is no less trustworthy than America's hosting. That's unlikely: https://nationalsecurity.virginia.edu/sites/default/files/fi... |
It looks like a liability, if the US's assault on Iran is any basis to go off-of. All the "frontier" AI in the world isn't helping the US win a brushfire war, it's a bit embarrassing I'd say. What's the contribution of frontier LLMs here, you think? What's the dangerous dual-use case, versus traditional computer vision and multimodal data aggregation systems? I'm not really seeing it, SENTIENT is far more impressive.
> When companies are hosting their models via API, they can have many other layers involved in serving those requests that can reduce abuse
That's not a safety feature. API providers do that to reduce their risk exposure and limit the liability they could face if someone attempted to abuse their service. Without the legal liability incentive, service providers would gladly remove those limits. As you've noted, Open Weight models don't have this feature at all, because the user is subsuming the liability; there's zero reason to drop or refuse requests for cybersecurity, "bioweapon research" or whatever stupid boogeyman topic you want to use to justify censorship. Of course, none of these LLMs have posed a legitimately unique threat to anyone in the past 6 years of "dual-use" LLMs being available - but a lack of evidence sure isn't going to stop your imagination.
> China puts more restrictions on models domestically than they do internationally.
> but the point is that this directly refutes your suggestion that China doesn't think they are a threat.
You're just describing a typical surveillance architecture. The United States does the exact same thing for data retention purposes, except they extend their surveillance globally instead of just imposing it just domestically. With open-weight LLMs, you are free to avoid that type of federal intervention and run the model or finetune it on your own hardware.
> That's unlikely
Nothing in that packet is very scary, but I will admit that it's hilarious how poorly a document like that ages in as few as 12 months:
As opposed to the US' AI policy, which is centrally planned and ideologically engineered through layers of national policy, and implimented by a coordinated collaboration among government, private tech companies and the military.Can you explain actual dangers, or are we going to remain at this impasse? I'm not super worried, yet.