Hacker News new | ask | show | jobs
by cheaprentalyeti 318 days ago
I ran into this post last week about how to manipulate Grok (and presumably other LLM's) for propagandic purposes [0]:

"But speech recognition remains a difficult and error-prone task, even for ChatGPT and Grok. So they implement a rather clever optimization: if there’s a reputable site with the video and a purported transcript, just report that result. And if there are a couple of sites that have similar transcripts, assign that a very high confidence rating. Normally, that will get a best-quality result with the least computation. But—

—but that optimization is vulnerable to maliciously false information.

The people behind this exploit posted the video and a completely fake transcript to a couple of sites which Grok trusts (including supposedly Reddit’s /r/Yiddish board, though I have not found that post). Once they confirmed that Grok was trusting their fake translation, they posted the seemingly-innocent question, and then pretended to be shocked and horrified at the response.."

[0]: accordingtohoyt.com/2025/08/06/beware-llm-ai-translations-of-foreign-language-videos-a-guest-post-by-j-c-salomon/