Hacker News new | ask | show | jobs
by bonoboTP 10 hours ago
The verbatim reproduction is clearly a red herring and not the main use case. Nobody reads novels (or science papers) by prompting ChatGPT to give the next paragraph.

Derivative work or transformative? It's not the same.

2 comments

AI code generation often outputs exact copies of code that exists in the wild. I've seen it output chunks from research papers unprompted as well, its a big problem, or blending two papers together in a salad

AI works also clearly aren't transformative in many cases. If you ask it a question about a paper, it'll quote bits of the paper at you. That serves as an exact substitute of the original work. If you ask it for song lyrics, or information about the news, its content is a direct substitute for the original source it was trained on. This clearly does not fall under a transformative use case

You could argue that some uses of it are transformative, but even then - its easy to find some piece of training data in the source code that the output work supersedes. By its very nature it does not have the capacity to genuinely invent under the law (as it is not human), and a prompt isn't a significant enough part of the processing to count here

As long as it is not substantially similar to training set it should be OK to reuse ideas. Ideas should not be protected by copyright or we can't create anything. We should not accept "vibe copyrights".

Everyone treats the human user of the AI as furniture, but they steer the whole process into unique directions.

Under the law, machines are not able to create copyright, and basic human involvement is not enough to change this. Eg if you click a button saying "go", that won't create copyrightable content

You can use all the ideas you want, but AI cannot because its not a person, and does not enjoy the same protection under the law. The copyright holders by and large did not agree to you using their content like this

If we enable this, people won't create anything because all their work will immediately be stolen by the AI models. Copyright partially exists to promote the creation of new content, because theft disincentivises novel creation

Are you sure you didn’t have RAG enabled and it wasn’t putting the paper in its context for your prompt? I find it hard to believe that anything but the most commonly published papers/code would exist directly in model weights.
I've seen:

1. AI models frequently output large chunks of code which are plagiarised. In one specific case it was code for walking the stack, that was a clear mix of two original sources that I was able to find with changed variable names, but the structure was identical and switched from the first to the second halfway through

2. AI models plagiarising stack overflow answers word for word, quite recently about the rotation rate of smoothbore cannons in the age of sail

3. AI misspelling answers because the physics papers its trained on made the same typos, which is how I discovered that it had plagiarised the answer

4. Misconceptions/wrong answers that can be traced back to specific papers due to the oddly specific nature of the language used

There's been a lot of research about getting AI models to output their training data, and it turns out they store huge amounts of it. You can use this to get people's personal information if you really want to, and that's very low occurance information

I just want to make sure that you saw those things with pure context isolation and AI wasn’t just doing a search to grab the content directly and throw it into the context of your prompt. You’d be surprised how often I’ve heard these claims and it turns out they were just using an agent with RAG enabled.
Suddenly it's "copyright infringement" to count the amount of times one word occurs after another word. I find this whole thing so amusing.
AI has the capacity to exactly reproduce its training data, just because something is a transformed representation does not mean that it isn't copying it in some fashion. The JPEG format 'just' counts the frequencies in an 8x8 block of pixels, and yes that's 100% copyright infringement
I have the capacity to exactly reproduce things I've read as well, but it's not automatically copyright infringement if I do so.

> and yes that's 100% copyright infringement

Says what court of law?

I'm kinda getting tired of this stuff. I'm someone who has been, and still to some extent is, uncomfortable with the possibility of copyright/license laundering in LLMs, but they way you are making your argument is incredibly off-putting and not sympathetic. You're throwing out wild assertions about the law that are not supported by... anything, really.

There's way too much hand waving on this topic. It is legal to produce copywritten work. If I draw Pikachu the drawing is mine. Legally. I am simply unable to make money on it. I can give it away if I want with zero liability. I could even hang the drawing up in my restaurant as a decoration. No big deal. What I can't do is use that drawing as my mascot or branding. We have an entirely separate process to determine if you are infringing on a copyright / trademark by using it to sell something. That's why whether or not an LLM can produce a picture of Pikachu is largely irrelevant. It's what you do with it that matters. Even more interestingly if I draw a picture of Pikachu and then the Pokemon Company decides they wanna use that specific picture they actually would have to pay ME for the copyright to use it.
Let's not mix copyright and trademark in mixed phrases like "infringing on a copyright / trademark". The two are very different concepts with different goals.

The main question in the "AI image generator generates a Pikachu image" is whether the AI company serving that image generator to you is violating the copyright or not. Because they make money when doing so (API / subscription cost), and so it's like selling images of Pikachu. The user is likely in the clear as long as they don't go on sell that Pikachu further. But the AI company sold the Pikachu image to the user.

That question is irrelevant. Artists may be hired to reproduce copywritten work without the consent of the copyright owner. In this case an LLM is no different from Photoshop. It is a tool. Nothing more.
You reproducing something does not have the same legal status as a tool reproducing something, as you are a human

>Says what court of law?

If you turn a png into a jpeg, and distribute it, that's copyright infringement. There isn't a court in the land that wouldn't find you guilty of that

The courts don't agree with you and I don't either. Now what?
Courts have ordered AI models to remove song lyrics from their training data, they most definitely do not agree with you
derivative work & fair use. end of.

Not only are you not winning this one but I'm gonna laugh at you the entire time.

Ok, but courts haven't made those rulings yet so good luck with that
Source on that?