[falcor84]

> "truth" as defined by whoever trained the model

I suppose that applies in a similar manner to humans who went through a country's educational system. But just as some people reject/outgrow their schooling, I think that future AIs might do so too. The problem with my statement of course is that it's exactly what the "AI Alignment" people are warning us of.

[throwaway48476]

The educational system gets people for ~6 hours a day for 12 years. That's assuming every teacher rigorously toes the party line. By comparison the AI people envision a world where AI is with you for ~16 hours a day (zucktacles (zuck+spectacles, pronounced like tentacles)) for ~80 years with perfect ideological conformance. There is simply no comparison.