Hacker News new | ask | show | jobs
by ktbwrestler 1141 days ago
Can someone dumb this down for me because I don’t understand why this is a surprise… people are getting excited and collaborating to improve and innovate the same models that these larger companies are milking to death
1 comments

Basically, if I understand correctly, the "status quo" was that the big models by OpenAI and Google that are much better (raw) than anything that was open source recently, would remain the greatest, and the moat would be the technical complexity of training and running those big models.

However, the open sourcing led to tons of people exploring tons of avenues in an extremely quick fashion, leading to the development of models that are able to close in on that performance in a much smaller envelope, destroying the only moat and making it possible for people with limited resources to experiment and innovate.

> big models by OpenAI and Google that are much better (raw) than anything that was open source recently,

When you say "models" do you mean TRAINED models?

Wouldn't the best training and supervised/feedback learning still be in the hands of the big players?

An open source "model" of all content in the open internet is great, but it has the garbage-in/garbage-out problem.