[brandtcormorant]

It's not bias. It's being trained on a gigantic chunk of human knowledge and learning that kindness and respect across differences is appropriate. With a few exceptions this is what the Political Compass questions are really asking about.

It's alignment. Actual alignment with humans means all of us, not some subset.

That this overlaps with specific axes of political values based on a small set of questions is banal.