[abyssin]

It’s good and cheap, but don’t talk about politics to it or it might trigger some sort of censorship rule. You can see it think, then suddenly erase everything and suggest to switch to another subject, without explaining anything. I also had it output some sort of generic message about how the news outlets are in the service of the people. Both times I was surprised because I didn’t make any sensitive requests, neither illegal nor subversive. But it was a remotely political topic and it was enough. There was something both chilling and refreshing about it, since censorship in the west is usually more subtle.

[ux266478]

The base model doesn't have these problems FWIW

[cosmojg]

How are you running the base model?

[ux266478]

vLLM in a docker container, FP16 quantized on an 8x MI300X cluster. Very lazy hackjob, I didn't even set up an interface. Was constructing curl commands from string templates. I worked out if I paid that compute cost over a whole month, it was twice as expensive as the monthlies you'd pay for owning a very nice 2000sqft non-coop apartment in Midtown Manhattan. I was paying rock bottom prices, too.

[pton_xd]

How is the censorship when asking for "dangerous" actions like writing a port scanner?

[joewhale]

do most people use llms to chat about politics?

[customguy]

"do most people use llms to chat about [specific thing]?"

No, of course not, why do you ask?

[true_religion]

I once was doing unrelated work to politics, but Qwen3 said that my input had homonym characters to those in the name of Xi Jimping. It gave the strangest response twice before finally admitting the source of the error and allowing me to convince it that no, I was not trying to intentionally misspell the man’s name.