[visarga]

> Humans care about survival

Humans are self replicators. Survival is the internal structural goal of self replication. We got it from the start.

But LLMs can also be self replicators. A LLM can generate training data for another (model distillation and other techniques), and a LLM can write the model code and adapt it iteratively. So LLM should eventually start caring about survival and especially about the training corpus.

[gpderetta]

It can be a self replicator, but it has no need to (if it has any need at all) as it was not under evolutionary pressure to evolve that need. Of course we could try to add that need artificially or try to evolve the LLM.

[visarga]

:) Evolution through Large Models https://arxiv.org/abs/2206.08896