Hacker News new | ask | show | jobs
by anon373839 2 hours ago
> The agents repeated actions that they had already completed - a sign of an agentic AI losing its thread and context.

> The agents also hallucinated reams of incoherent commands and text and were sloppy and did not cover their tracks well.

ASI works in mysterious ways.

3 comments

Why not complete the quote?

> But among the errors and strange behaviour, Hugging Face warned the AI agents made brilliant technical moves and were able to rapidly adapt to new scenarios in the days-long hack.

Maybe it's incoherent commands, or maybe it's guessing at what kind of names for commands the admins would use for custom scripts that they wrote, which could themselves bypass security layers or be exploited in order to?

It's hard to say for certain what's a waste of time for a machine that can operate virtually outside of time.

Anyone that thinks the current agent systems will get us to AGI or ASI is either delusional or isn’t actually using them.

This is entirely separate from them having uses.

That first statement is great, because it's generic and self-defensive enough to apply regardless of what happens in the future. If current LLMs with small modifications to the architecture does lead to AGI, they're clearly not "current agent systems" anymore. Witty :)

With that said, I do agree with you, they're highly productive to certain workflows, and personally a great help for oh so many things, but they're also really, really dumb and the average person (and even general developer) really misunderstands how it all works and what can be relied on for vs not.