That's really a non-issue. Anything copyrightable is non-trivial in length and complexity to the point that an LLM is not going to verbatim output that.
>>> Please write a hello world app in java
```java
public class HelloWorld {
public static void main(String[] args) {
System.out.println("Hello, World!");
}
}
```
cat /bin/true and /bin/false if you are on a Solaris etc... as an example too.