[the8472]

They are "just composites" in the sense that the NN learns to decompose an image into multidimensional concepts both local and global (the latent space) and then assemble new images from anywhere in that space even at points that weren't in the training set. Of course if the training set is small then it'll overfit to mostly reproduce the inputs.

https://openai.com/blog/multimodal-neurons/

[mouzogu]

it sounds like jargon to me as idk much about neural networks. i guess its kind of a highly complex and nuanced composition. but essentially its still just a sophisticated combination of existing things.

i guess this is the same as human creativity in the sense it depends on prior experience. its more the "does not exist" that bugs me a bit.

tx for the detailed response tho, wish i was smart enough to understand.

[the8472]

> i guess this is the same as human creativity in the sense it depends on prior experience.

That's roughly the idea. Although I didn't want to make that analogy because someone would try to overextend it and point out that an artist can do X and a neural network can't and therefore it's wrong.

> its more the "does not exist" that bugs me a bit.

Well, if someone learns what a sneaker generally is and then draws a fantasy-sneaker that is still recognizable as a sneaker because it stays in the general confines what is considered "a sneaker" then does that sneaker suddenly exist?