|
|
|
|
|
by leobg
237 days ago
|
|
Well said. And it makes sense, if you define intelligence as the ability to successfully predict the future. And how interesting that that is literally how LLMs are trained during pretraining. Like Ilya said: To predict the name revealed as the murderer at the end of a detective novel, you must have followed the plot, have world knowledge about physics, psychology, etc.. And that’s what you’re pointing at here. Testing yourself on the ability to predict during a lecture is like running a loss function to keep you on your toes. |
|
Wait, can people do this??