[saurik]

But since these things are more like humans than computers, to build these autonomous systems you are going to have think in terms of full industrial engineering, not just software engineering: pretend you are dealing with a surprisingly bright and yet ever distracted employee who doesn't really care about their job and ensure that they are able to provide the structure you place them in value without danger to your process, instead of trying to pretend like the LLM is some kind of component which has any hope of ever having the kind of reliability of a piece of software. Organizations of humans can do amazing things, despite being extremely flawed beings, and figuring out how to use these LLMs to accomplish similar things is going to involve more of the skills of a manager than a developer.

[somenameforme]

Their output is in natural language, that's about the end of similarities with humans. They're token prediction algorithms, nothing more and nothing less. This can achieve some absolutely remarkable output, probably because our languages (both formal and linguistic) are absurdly redundant. But the next token being a word, instead of e.g. a ticker price, doesn't suddenly make them more like humans than computers.

[nisegami]

I see this "next token predictor" description being used as a justification for drawing a distinction between LLMs and human intelligence. While I agree with that description of LLMs, I think the concept of "next token predictor" is much, much closer to describing human intelligence than most people consider.

[somenameforme]

Humans invented language, from nothing. For that matter we went from a collective knowledge not far beyond 'stab them with the pokey end' to putting a man on the Moon. And we did it the blink of an eye if you consider how inefficient we are at retaining and conferring knowledge over time. Have an LLM start from the same basis humanity did and it will never produce anything, because the next token to get from [nothing] to [man on the Moon] simply does not exist for an LLM until we add it to its training base.

[flir]

It's got an instant-messaging interface.

If it had an autocomplete interface, you wouldn't be claiming that. Yet it would still be the same model.

(Nobody's arguing that Google Autocomplete is more human than software - at least, I hope they're not).