Hacker News new | ask | show | jobs
by skeledrew 27 days ago
Bonkers compute only in the beginning. Over time it'll reduce as models are made more efficient.
1 comments

Or it will stay the same as the efficiency gains will be eaten up by bigger models
Nah they'll hit a ceiling. Can only get so big before things collapse. And besides, they've already churned through the Internet's data. Not much new content left in the wild and patterns in other data forms (audio, image, etc should be pretty low by comparison.
I agree we're at diminishing returns, but when brain scanning gets good enough you have a better dataset than the internet, Facebook is deep into that research.
Suddenly got dark up in here...