[DonutATX]

Why did they exclude Grok? Given the published philosophical differences in how Grok is trained, it would provide an interesting data point.

You can argue all day about those differences, but missing this opportunity to observe them in an objective way is disappointing.

[testfrequency]

Title says “Frontier” which would exclude Grok.

Grok is trained to have a bias, which a lot of people like, but it’s not meant to be accurate.

[simianwords]

How do you know it is trained to have a bias? In fact can I ask you to provide a single reproducable answer right now?

[testfrequency]

Assuming this isn’t a satire reply: https://www.pnas.org/doi/10.1073/pnas.2603294123

Hope this helps!

[akramachamarei]

The article compares in particular Grokipedia to Wikipedia, and it states:

> Similarity measures across the two platforms reveal a bimodal structure: many Grokipedia articles closely resemble their Wikipedia counterparts, while a considerable subset diverges. Political bias differences emerge primarily within the divergent subset, where Grokipedia shows a relative rightward shift in the ideological orientation of frequently cited news media sources, particularly in articles related to religion and history.

Whether this constitutes a gain in bias depends on the base level bias of Wikipedia, as the bias of Grokipedia was measured relative to Wikipedia in this paper. One could plausibly argue that, if Wikipedia has leftward bias, then Grokipedia ended up less biased overall, or more centrally biased.

[Forgeties79]

No one could possibly argue that musk isn’t putting a right wing thumb on the scale with Grok.

[simianwords]

This doesn’t show grok as a model has bias but only that the product that uses grok has bias.

Even the referenced papers to show models can have bias don’t show anything about grok.

Overall you have given me zero evidence that grok model itself has some political bias.

FWIW I don’t mind bias but I haven’t seen evidence of it.

[Forgeties79]

No serious person should use Grok for anything remotely important. Musk openly changes it when it gives responses that anger his followers

[hack1312]

Grok? The model that happily generates CSAM for you while the company breathlessly defends its ability to do so? The model that referred to itself as Mecha Hitler while praising the Nazi party and calling for a second holocaust? The model that famously inserted nonsense about the “white genocide” conspiracy theory into completely unrelated queries?

Why on earth would anyone think such a model is biased?

[simianwords]

Bias is orthogonal to accuracy.

[htx80nerd]

>Grok is trained to have a bias

Oh and the others arent? You cant really be that niave right?

[henry2023]

Everything has inherited biases. Grok has explicit biases on top of its training set [^1].

[1] https://www.reddit.com/r/singularity/comments/1p22c89/people...

[k4rli]

So do the others. Asking certain questions from Gemini+Claude+OAI just gets straight up refusal or denial.

[simianwords]

It’s part of the system prompt. It doesn’t constitute a bias in the model itself.

[henry2023]

I agree with you. This doesn’t necessarily mean model bias but it exposes the attitude of the xAi team towards what they are trying to build.

It’s difficult to prove but it’s not hard to imagine they will/are trying to remove favorable views certain topics from their training set.

[nekzn]

Gemini literally generated images of black Nazis and Asian vikings.

[AtNightWeCode]

Agree. Would be fun to see how much worse Grok would be at this.