Hacker News new | ask | show | jobs
by wrxd 23 days ago
Or it will stay the same as the efficiency gains will be eaten up by bigger models
1 comments

Nah they'll hit a ceiling. Can only get so big before things collapse. And besides, they've already churned through the Internet's data. Not much new content left in the wild and patterns in other data forms (audio, image, etc should be pretty low by comparison.
I agree we're at diminishing returns, but when brain scanning gets good enough you have a better dataset than the internet, Facebook is deep into that research.
Suddenly got dark up in here...