[altmanaltman]

Except they don't really "think" and they are not conscious. Expecting your toaster or car to never rise up against you is a good strategy. AI models have more in common with a toaster than with a human being. Which is why they cannot be economic agents. Even if corporations profit off them, the corporation will be the economic agent, not the AI models.

[DrScientist]

It's a classic worm or virus an economic agent? Goal is to acrue compute resources in order to survive and spread?

If you added the ability of the programme to acrue money, and the ability to spend that money to further the survival goal in an adaptive way. What could happen?

Would it do insider trading, market manipulation, drop shipping, click fraud, scamming or become a opinion for hire 'think tank'?

[brazukadev]

Give them a body and means to protect themselves and no matter what you say, they will be thinking.

[phantasmish]

We may as well be talking about the hypothetical properties of pixies or angels.

[esafak]

They may not be conscious but they exhibit the hallmarks of thinking. What qualities of thinking do they not possess?

[altmanaltman]

Exhibiting/showing symptoms of thinking doesn't necessarily mean they are actually thinking though. This paper explains it much better than I can: https://ml-site.cdn-apple.com/papers/the-illusion-of-thinkin...