[mikestorrent]

Are you not aware of open-weights models and local generation? I think the vast majority of deepfake content is being genned in basements on RTX cards, not on public providers. People already have all this content, and have archives of it, and can run it airgapped. Cat is out of bag.

[pegasus]

I would be very surprised if that would be the case. Maybe you mean deepfake content generated by organized crime or state actors, but that surely is a tiny fraction of what's being generated on Grok or other platforms.

[littlestymaar]

I am well aware of them, and I'm well aware that they are very niche as I'm the only one of my surrounding to use one of those. And those very models are being developed by tech giants and VC backed companies, on which regulation have leverage.

The fact that a small black market exists doesn't mean regulating the mainstream market doesn't matters.

Also, most people like you fail to realizes that the EU only has mandate from the member states to regulate the economy. The EU has no business dealing with people using SDXL finetunes on RTX cards in their garage.

[mikestorrent]

> The EU has no business dealing with people using SDXL finetunes on RTX cards in their garage.

I agree in theory, but all it takes is one deepfake video to cause the kinds of trouble the regulations are designed to stop, right?

[littlestymaar]

No. Again, this regulation is about regulating businesses because that's what the EU is about.

The general use or creation of deepfake for porn, harassment, or election manipulation, is outside of what the EU can regulate as an institution, it is the responsibility of member states. (The same way the EU can impose rules on platform with respect to copyright violations, but cannot enact rules against piracy in general, these are always made by member states).