Hacker News new | ask | show | jobs
by darod 10 days ago
You can argue that reverse engineering anything is as hard if not harder than engineering something. I can’t imagine distillation is any different.
1 comments

Distillation is objectively easier than training a model from scratch, that's why all these Chinese labs are doing it.
Training a model is objectively easier than generating the sum total of human creative output prior to 2020. That's why the big labs are doing it. What's the difference here?
Reverse engineering has stronger protections than merely copyright infringement