[pffft8888]

They can do this in people, too, not just LLMs.

Imagine the mistakes that can be made by changing one fact but not reconfiguring the whole network.

Thhese guys remind me of when I used to change EXEs in hex editors then notice "unrelated" weird glitches.

[mrtranscendence]

That’s what I’d be afraid of, though I haven’t read the relevant literature so maybe this is addressed. Since there are way fewer parameters than encoded facts it seems like it would be difficult to change one fact without messing with others.