|
|
|
|
|
|
by cube2222
1141 days ago
|
|
|
Basically, if I understand correctly, the "status quo" was that the big models by OpenAI and Google that are much better (raw) than anything that was open source recently, would remain the greatest, and the moat would be the technical complexity of training and running those big models. However, the open sourcing led to tons of people exploring tons of avenues in an extremely quick fashion, leading to the development of models that are able to close in on that performance in a much smaller envelope, destroying the only moat and making it possible for people with limited resources to experiment and innovate. |
|
|
When you say "models" do you mean TRAINED models?
Wouldn't the best training and supervised/feedback learning still be in the hands of the big players?
An open source "model" of all content in the open internet is great, but it has the garbage-in/garbage-out problem.