Hacker News new | ask | show | jobs
by mempko 959 days ago
Google Deep Mind just demonstrated that transformers don't generalize well outside their training set.

https://arxiv.org/abs/2311.00871

The question I have is, what if these agents are really good at doing things they learned about, but not in new things? How will that impact people's actions?

Will we end up with a static world of people doing only things the AI can do? A kind of 1999 Matrix stasis world of 'the best we can do now'?

What will happen to what Arthur Kessler called 'blue' thoughts in such an AI world?

Because IMO, the purpose of computers is to make models and see what happens. Test ideas in a powerful way via computation. If the AI can ONLY select existing models and not make news ones, or even prevent you from making new ones, then I don't see how these AI agents are anything but a step backwards.

Alan Kay gave a great talk called The Best Way to Predict the Future is to Invent it taht touches on some of these ideas.

https://youtu.be/Odmx-ScL-8o?si=PMhZyxTtNdwBumKj