[gtowey]

Only because they have compressed and encoded the entire sum of human knowledge at their disposal. There are models for everything in there, but they can only do what has been done before.

What's more amazing to me is the average human, only able to hold a relatively small body on knowledge in their mind, can generate things that are completely novel.

[sharemywin]

People assume training on past data means no novelty, but novelty comes from recombination. No one has written your exact function, with your exact inputs, constraints, and edge cases, yet an LLM can generate a working version from a prompt. That’s new output. The real limitation isn’t novelty, it’s grounding.

[gtowey]

Synthesis is different than genesis.

Just because there are lots of tasks which can be accomplished without the need for anything novel doesn't mean LLMs can match a human. It just means humans spend a lot of time doing some really boring stuff.

[deadbabe]

That’s only part of it. The true intelligence is knowing what to recombine, and this is where AI falls short.

[cheevly]

I hear this constantly. Can you produce something novel, right here, demonstrably, that an LLM couldnt have produced? Nobody ever can, but it’s sure easy to claim.

[Procrastes]

I'm going to assume you mean this seriously, so I will answer with that in mind.

Yes, I can. - I can build an unusual, but functional piece of furniture, not describe it, not design it. I can create a chair I can sit on it. An LLM is just an algorithm. I am a physically embodied intelligence in a physical world.

- I can write a good piece of fiction. LLMs have not demonstrated the ability to do that yet. They can write something similar, but it fails on multiple levels if you've been reading any of the most recent examples.

- I can produce a viable natural intelligence capable of doing anything human beings do (with a couple of decades of care, and training, and love). One of the perks of being a living organism, but that is an intrinsic part of what I am.

- I can have a novel thought, a feeling, based on qualia that arise from a system of hormones, physics, complex actions and inhibitors, outrageously diverse senses, memories, quirks. Few of which we've even begun to understand let alone simulate.

- And yes I can both count the 'r's in strawberry, and make you feel a reflection of the joy I feel when my granddaughter's eyes shine when she eats a fresh strawberry, and I think how close we came to losing her one night when someone put 90 rounds through the house next door, just a few feet from where her and her mother were sleeping.

So yeah, I'm sure I can create things an LLM can't.

[motoxpro]

So the only thing I am seeing here is physical or personal (I have no idea how you feel or what your emotions are. You are a black box just as an LLM is a black box.)

The only thing you mentioned is the fan fic and I would happily take the bet that an LLM could win out against a skilled person based on a blind vote.

[Cyph0n]

Me personally? No. Us collectively? Absolutely.

Was an individual mind responsible for us as humanity landing on the moon? No. Could an individual mind have achieved this feat? Also no.

Put differently, we should be comparing the compressed blob of human knowledge against humanity as a collective rather than as individuals.

Of course, if my individual mind could be scaled such that it could learn and retain all of human knowledge in a few years, then sure, that would be a fair comparison.

[UncleMeat]

I want to see an LLM create an entirely novel genre of music that synthesizes influences from many different other genres and then spreads that genre to other musicians. None of this insulated crap. Actual cultural spread of novel ideas.

[11101010010001]

take my pound of flesh.

[possibleworlds]

Highlife music