Hacker News new | ask | show | jobs
by ragnese 1121 days ago
As someone with no knowledge of the fields of machine learning and artificial intelligence, I wonder how much of recent AI stuff is due to "true" Moore's Law (GPUs and such getting much faster/cheaper), and how much is due to the data version of Moore's Law (web-scale data farming/storage to "teach" LLMs and such).
1 comments

Making use of more data requires more compute (e.g., longer training, more powerful hardware, or both).
At this point I'm not sure progress is due to Moore's Law as stated originally (cheaper compute) than it is due to companies just spending more on compute. Effect is the same for now, but with a clear limit.