Hacker News new | ask | show | jobs
by sghiassy 506 days ago
Because building a frontier model is expensive. But building a model as good as an existing frontier model is cheap (re: distillation).

https://en.m.wikipedia.org/wiki/Knowledge_distillation

So the takeaway is they have no moat

2 comments

Beautiful and concise, much better than my word salad.