Hacker News new | ask | show | jobs
by bcjdjsndon 46 days ago
> You need a similar degree of open mindedness and imagination to be able to discern what such an intelligence being would be capable of.

Or a naive grasp of reality... You can posit all the super intelligence you like, actually creating it is another story entirely.

For instance, it's clear the transformer architecture is brute force and memory hungry... Why hasn't ai improved on this? After ten years still no luck?

Doesn't look good does it?

1 comments

You're gesturing at some fundamental limit that, if it exists, there is no evidence of peaking yet. It is not rigorous to say AI has not contributed to architecture improvement.
The article claims AI will recursively self improve and infinitum... It's had ten years and hasn't managed to innovate beyond what humans invented. This AI is genius right? It has near unlimited compute power and time, and I cannot be the first to think of this idea, so it's certainly been tried.

Transformers require massive data and compute, the smarter you want you're AI, the worse this situation gets. This isn't a hard limit but it certainly limits how quick it happens, and let me tell you, general purpose robots aren't happening anytime in the next 25 years