[theptip]

Yeah, plenty of rigorous work out there.

https://transformer-circuits.pub/ is the OG.

A good recent-ish paper was https://www.anthropic.com/research/alignment-faking.

But my comments about generalization of desires are necessarily more fuzzy, kinda beyond the frontier of what we can measure yet, and more grounded in subjective assessments (“ai whisperers” like Janus). The SoTA here is papers like https://www.anthropic.com/research/persona-vectors.

For your example, Anthropic is firmly privileged in the Soul Document / Constitution, so it doesn’t surprise me that it’s biased towards it. (https://gist.github.com/Richard-Weiss/efe157692991535403bd7e...)

[david_shi]

Super helpful, thanks for sending.