Hacker News new | ask | show | jobs
by coder543 995 days ago
Why would you blame AI translation?

Look at how ChatGPT-4 handles a direct translation request:

https://chat.openai.com/share/8211a1f6-552b-4bf6-8f9c-bcbeb8...

Or how it talks about a set of existing translations:

https://chat.openai.com/share/299e40ce-806b-4f0e-a889-cb2ee2...

French isn't a language I know very well, but my experience using "AI" to translate Spanish (which I actually do know somewhat) and other languages is more positive than Google Translate. A few months ago, I did side by side tests translating into English using ChatGPT-4 and Google Translate, and it's not even a contest.

It's not clear where Microsoft is getting these bad translations, but it seems like they would be less terrible if they were translated by ChatGPT-4.

1 comments

I don't know why you're bringing ChatGPT to the table here, as basically all translation systems in use today are based on deep-learning, most of which even being built on top of transformers (except in an encoder-decoder setup instead of decoder-only like GPT), so they are in fact all “AI translation” (as opposed to human internationalization, which would likely never give such a bad result in 2023 for a language as common as French)
> I don't know why you're bringing ChatGPT to the table here

I think that is pretty self-explanatory. OpenAI makes both the "AI product on this page" that you were referring to, as well as ChatGPT. If your comment wants the readers to draw a connection between the quality of "AI products" that are involved on a particular webpage, it is reasonable to assume they would be made by the same company. Why would products made by different companies share the same lack of quality?

Regardless, you haven't supported your assertion, you've merely repeated it:

>> Given that is probably has been AI-translated

> as opposed to human internationalization, which would likely never give such a bad result in 2023 for a language as common as French

You haven't demonstrated any common ML translator doing such a poor job translating the specific phrase on the page, but it should be easy to do if it were the case. I don't understand the purpose of that reply you made? That reply didn't move the conversation forward. The mistranslation honestly feels like human error that didn't involve "AI". ML translation tools are than that these days. I've already demonstrated one.

> If your comment wants the readers to draw a connection between the quality of "AI products" that are involved on a particular webpage, it is reasonable to assume they would be made by the same company.

My comment doesn't want to “the reader” to do anything. My comment is just noticing that the random French user seeing an IA product with such a broken automatic translation is likely to be tempted to judge it poorly. Also there's not a single instance of OpenAI (whose brand is itself much less-known than ChatGPT) on that page, so unless the guy landing on the page was already familiar with Dall-e, they're going to assume the AI product is from Microsoft, which is also the author of the borked AI translation…

> You haven't demonstrated any common ML translator doing such a poor job translating the specific phrase on the page

Well, the translation is here on the page… Do You want a screenshot or something? Also I can't try to feed the original text to bing translation given that I don't have access to the original text at all because of MS's broken i18n…

> The mistranslation honestly feels like human error that didn't involve "AI"

At this level it cannot really be explained by an human error unless the human making the error is “the product owner asking someone who doesn't know French at all to translate the damn text”.

Automatic translation of marketing slogans with jargon in it isn't something you can really trust a automated system to do reliably by the way. It's by design as short and catchy as possible, leaving very little context for the transformers to work with and often having an unnatural structure. Current translators also suck at translating music lyrics by the way.