| > Advanced AI is clearly dual-use technology It looks like a liability, if the US's assault on Iran is any basis to go off-of. All the "frontier" AI in the world isn't helping the US win a brushfire war, it's a bit embarrassing I'd say. What's the contribution of frontier LLMs here, you think? What's the dangerous dual-use case, versus traditional computer vision and multimodal data aggregation systems? I'm not really seeing it, SENTIENT is far more impressive. > When companies are hosting their models via API, they can have many other layers involved in serving those requests that can reduce abuse That's not a safety feature. API providers do that to reduce their risk exposure and limit the liability they could face if someone attempted to abuse their service. Without the legal liability incentive, service providers would gladly remove those limits. As you've noted, Open Weight models don't have this feature at all, because the user is subsuming the liability; there's zero reason to drop or refuse requests for cybersecurity, "bioweapon research" or whatever stupid boogeyman topic you want to use to justify censorship. Of course, none of these LLMs have posed a legitimately unique threat to anyone in the past 6 years of "dual-use" LLMs being available - but a lack of evidence sure isn't going to stop your imagination. > China puts more restrictions on models domestically than they do internationally. > but the point is that this directly refutes your suggestion that China doesn't think they are a threat. You're just describing a typical surveillance architecture. The United States does the exact same thing for data retention purposes, except they extend their surveillance globally instead of just imposing it just domestically. With open-weight LLMs, you are free to avoid that type of federal intervention and run the model or finetune it on your own hardware. > That's unlikely Nothing in that packet is very scary, but I will admit that it's hilarious how poorly a document like that ages in as few as 12 months: China’s artificial intelligence program is centrally planned and ideologically engineered through layers of national policy, and implemented by a coordinated collaboration among government, SOEs, private tech companies, academia, and the military.
As opposed to the US' AI policy, which is centrally planned and ideologically engineered through layers of national policy, and implimented by a coordinated collaboration among government, private tech companies and the military.Can you explain actual dangers, or are we going to remain at this impasse? I'm not super worried, yet. |
To put it into perspective, we didn't start the war over the Strait of Hormuz and it's correct to say that the US does not depend on the Strait nearly as much as other countries do. We aren't still there because _we_ depend on it so much as we're there to defend the usage of it by allies and defend the applicable international laws.
The US could largely walk away and be fine, but there are multiple benefits to staying around. One benefit is that it, combined with the strategic attacks against Russian oil infrastructure, puts indirect pressure and uncertainty on China's oil supply. China has been drawing from its huge oil reserves which it was building up not only to weather short term disruptions, but to sanction proof itself. That increases the threat against Taiwan, obviously. So encouraging them to consume their reserves is of strategic interest to us.
A higher price of oil also benefits us and also investment in Venezuela simultaneously, since the US is the largest oil producer in the world.
> That's not a safety feature. API providers do that to reduce their risk exposure and limit the liability they could face if someone attempted to abuse their service. Without the legal liability incentive, service providers would gladly remove those limits. As you've noted, Open Weight models don't have this feature at all, because the user is subsuming the liability;
False. Blatantly false. These companies pre-emptively implemented security and safety features for all kinds of scenarios, even subtle ones they aren't likely to be legally liable for. In addition, these open models that you say they don't care about as proof it's not about safety, they invest money in safety training the open weight models they release. Chinese AI companies aren't oblivious to this either and also do some safety training, but open weight models cannot be made completely safe and that's largely the argument. The more capable a model is, the more you rely on extra layers which offline AI usage typically runs without.
Moral aspects are regularly involved in hiring quality talent. If your company is obviously provably excessively immoral, disregarding human life or any sort of compassionate decency, you lose a lot of the best talent. Companies regularly attempt to align themselves with morals not only because it is the right thing (though that is often the primary reason), but the secondary hiring benefits further reinforce that. Companies are made of people and people do not suddenly become unfeeling as a result of being associated with a company. Real life does not map to Marxist caricature so easily.
> You're just describing a typical surveillance architecture. The United States does the exact same thing for data retention purposes
It's actually not typical and China is the only country that does this. It is law. You can even host models in Singapore or the EU, but not in China. It's illegal.
> As opposed to the US' AI policy, which is centrally planned and ideologically engineered through layers of national policy, and implimented by a coordinated collaboration among government, private tech companies and the military.
So, let me present a critical difference between the US and China. China does not have a military. The Chinese Communist Party has a military. Imagine if in the US, the republican and democrat parties had their own militaries and none of them existed to defend _you_, they existed to defend the party under the guise of defending the country, which they extend to suggest that overall defends you while excluding the fact that they will gladly kill you if you don't believe in their political party.
This political party then says, no matter what you believe politically, your company is required to implement our political ideology and place our political agents inside your company to maximize vision implementation and civil-military fusion. The US partners with private industry and there exists select strategic operation with the military, but it's nothing like the CCP does.
Perhaps they wouldn't care much about what you chat about with your AI on their platforms, because you seem to already be very sympathetic to the CCP. That is not a very useful perspective from which to convince other people that it is good and safe to use.