[Enginerrrd]

>It's like arguing "Since AIs will be able to comment on Hacker News, humans won't."

I'm not so sure. I often go into threads on HN and realize that every idea I could come up with on the subject has already been expressed better than I could do it, with greater expertise, and cited sources. I don't comment in those threads. If AI bots could populate a thread with every likely human thought and argue it with depth and sophistication in a well reasoned, yet carefully approachable and well-explained way, well then... again I don't think I'd feel like I would be adding much value by participating.

[neohaven]

And yet, here I am, bringing up something no one seems to bring up in the thread. One would also logically come to the conclusions that disparate AIs with disparate interests would find different things to express, to make music about, to draw about.

What distinguishes music written by AI from music made from humans? I have a story to tell. If the AI has a story to tell, one that speaks to our human emotions, it might make good music. But the point is to communicate. Even if you take, for example, someone else's words, fit them to a different model in a different field, viewpoint... You might get interesting things. You could make a cover of someone else's song, with your twist. Adding your emotion to the melting pot. AIs might be good at that, just like that, but only through communicating. Just like us. We have no idea whether they'll be better than us at doing it, or merely equivalent. We have no idea what is lossy in our sharing of mental models. Perhaps it is an unsolvable problem, which we will find out in the same way we found out about Gödel's Incompleteness.

It seems to me like we fail to understand how unique we are. We are in a unique position to shape what comes after us, and we are blind to how much we unconsciously select for things. We have an innate mental model of "humanity" we are trying to transmit to machines, and I am not sure we fully grasp it well enough to make sure we are creating something like us. We fail to do it properly to humans, sometimes, who actually do share most of our instincts and habits. Something entirely different from us? Color me skeptical.

This kind of debate only highlights this, to me.

[sujNansnam]

What your comment suggests to me is that good composition requires an agent with a world model and generalized task-solving ability, along with a personality. I think developing the world model and task-solving will be the hard part, and if we can do it, it won’t be that hard to make it have a personality too. That’s just another task.

[neohaven]

What my comment is trying to suggest is that AIs are not proven to be different from us. They might not have one "ultimate" form. They might be just like us humans. Diverse.