[pier25]

> Guy gives non-deterministic software root access, desaster happens.

I agree the guy is an idiot for trusting these AI models.

OTOH AI companies keep running and marketing their services with zero accountability for mistakes.

[JohnMakin]

I guess people are finding out the hard way you do sorta need technical people to say, "hey, maybe this isn't a great idea" rather than trusting marketing hype that says technical skills are dead.

[0xpgm]

I wonder, how should an AI company be accountable for non-deterministic nature of AI, which is a fundamental property of the said AI?

People have been drinking too much hopium they have lost touch with reality.

Everyone needs to properly understand these tools before they use them for anything serious.

[pier25]

At the very least, when an agent can delete a production database you should get an obvious warning whenever you enable it. Marketing wouldn't like it though.