Hacker News new | ask | show | jobs
by wongarsu 1100 days ago
OpenAIs modus operandi is basically "does it get better if we make it bigger". Of course they are constrained by economical factors like the cost of training and inference, but if they have the choice between making the model better or more efficient they choose the better model.

I believe over the next years (and decades) we will figure out that a lot of this can be done much more efficiently.

Another problem with the analogy to humans if obviously that these models know much more than any one human can remember. They are trained on our best approximation of the total sum of human knowledge. So the comparison to any one human will always be fraught with problems.