[SkyBelow]

>These two points seem slightly conflicting. Why if a human is truly more creative than AI, must it experience "the magic and absurdity of life" if it can be creative without "combining things into output"?

I agree, yet I also think AI is extremely limited in terms of new creativity.

My guess is that humans operate on some deeper level. Much like the grokking model example where it easily trained on the training data, but only later did it really start to understand the deeper problem space and 'grok' the problem, I think LLMs are doing something similar with human thought. LLMs can throw more compute, but they are still lacking some introspection/drive that leads to the better creativity of humans. Grokking this from the training data might not be possible, or it might take some fundamentally different approach, or even an imperfection in humans that LLMs don't have (ego/drive?).

This isn't to say that LLMs could never do it, but the cost to do so might require magnitudes more scale in training times and size. Or it could be in the next model released. Or maybe they already can, but that gets trained out in favor of overall more general correctness accross all domains.