Hacker News new | ask | show | jobs
by PBnFlash 1000 days ago
Our use of data is WILDY inefficient currently.

Current training systems extract information on everything from every input. We don't read a cookbook to learn about space, but these models are twiddling weights all over these massive spaghetti balls of logic.

Looking at the data we have, the literal collection of all human knowledge and lamenting not having more is like standing on a ladder sideways.

But it's really starting to feel like pile of ladders is getting tall enough to bootstrap.

And these massive inefficient systems filled with data and churning matrixs will be set in order. And all the ladders laid end to end.