[jszymborski]

The Qwen models are, anecdotally, probably some of the best open weight models, particularly the MoE models.

They are also, anecdotally, super scary censored. Asking it if anything "interesting has happened in Tianamen Square?" And then refining with "any notable protests?" And finally "maybe something to do with a tank"... All you get is vague allusions to the square being a beautiful place with a rich history.

[impossiblefork]

Do you think it's done so carefully that you suspect that they have perhaps even removed texts mentioning the Tiananmen square massacre from the training set?

[jszymborski]

I have no special knowledge on the matter, but I imagine it's the same kind of alignment that prevents other LLMs from telling you e.g. how to make meth.