Hacker News new | ask | show | jobs
by littlestymaar 996 days ago
I love how the French internationalization of title of that page is “Créer art de mots avec IA”, which is almost at the “all your base are belong to us” of level of terrible translation.

Given that is probably has been AI-translated, it doesn't really inspire confidence about the AI product on this page if you're a French speaker.

4 comments

Why would you blame AI translation?

Look at how ChatGPT-4 handles a direct translation request:

https://chat.openai.com/share/8211a1f6-552b-4bf6-8f9c-bcbeb8...

Or how it talks about a set of existing translations:

https://chat.openai.com/share/299e40ce-806b-4f0e-a889-cb2ee2...

French isn't a language I know very well, but my experience using "AI" to translate Spanish (which I actually do know somewhat) and other languages is more positive than Google Translate. A few months ago, I did side by side tests translating into English using ChatGPT-4 and Google Translate, and it's not even a contest.

It's not clear where Microsoft is getting these bad translations, but it seems like they would be less terrible if they were translated by ChatGPT-4.

I don't know why you're bringing ChatGPT to the table here, as basically all translation systems in use today are based on deep-learning, most of which even being built on top of transformers (except in an encoder-decoder setup instead of decoder-only like GPT), so they are in fact all “AI translation” (as opposed to human internationalization, which would likely never give such a bad result in 2023 for a language as common as French)
> I don't know why you're bringing ChatGPT to the table here

I think that is pretty self-explanatory. OpenAI makes both the "AI product on this page" that you were referring to, as well as ChatGPT. If your comment wants the readers to draw a connection between the quality of "AI products" that are involved on a particular webpage, it is reasonable to assume they would be made by the same company. Why would products made by different companies share the same lack of quality?

Regardless, you haven't supported your assertion, you've merely repeated it:

>> Given that is probably has been AI-translated

> as opposed to human internationalization, which would likely never give such a bad result in 2023 for a language as common as French

You haven't demonstrated any common ML translator doing such a poor job translating the specific phrase on the page, but it should be easy to do if it were the case. I don't understand the purpose of that reply you made? That reply didn't move the conversation forward. The mistranslation honestly feels like human error that didn't involve "AI". ML translation tools are than that these days. I've already demonstrated one.

> If your comment wants the readers to draw a connection between the quality of "AI products" that are involved on a particular webpage, it is reasonable to assume they would be made by the same company.

My comment doesn't want to “the reader” to do anything. My comment is just noticing that the random French user seeing an IA product with such a broken automatic translation is likely to be tempted to judge it poorly. Also there's not a single instance of OpenAI (whose brand is itself much less-known than ChatGPT) on that page, so unless the guy landing on the page was already familiar with Dall-e, they're going to assume the AI product is from Microsoft, which is also the author of the borked AI translation…

> You haven't demonstrated any common ML translator doing such a poor job translating the specific phrase on the page

Well, the translation is here on the page… Do You want a screenshot or something? Also I can't try to feed the original text to bing translation given that I don't have access to the original text at all because of MS's broken i18n…

> The mistranslation honestly feels like human error that didn't involve "AI"

At this level it cannot really be explained by an human error unless the human making the error is “the product owner asking someone who doesn't know French at all to translate the damn text”.

Automatic translation of marketing slogans with jargon in it isn't something you can really trust a automated system to do reliably by the way. It's by design as short and catchy as possible, leaving very little context for the transformers to work with and often having an unnatural structure. Current translators also suck at translating music lyrics by the way.

Finnish translation is a horrible word-by-word thing, too. That does not work at all translating to a language that uses very few prepositions. Words like “for” and “to” get replaced with ones from a totally different context. The thing reminds me of machine translations from around 2000.

Sadly the new features on Windows, like forced Onedrive sync, also use similarly bad translations. Phishing emails have nowadays better Finnish than Windows does.

The Finnish caption is quite a bit worse than "all your base are belong to us" type of invalid grammar. Translating it back, even with best intentions (ignoring the naive attempt of translating "from" in place) it reads "Create images from AI generated words".
I remember the page presenting the AI chatbot used by Bing, the translations there were also terrible, even at a character level, with random CAPS, and to be honest still today I have no idea how it was possible.
Indeed the translation is very poor. I just tried the Micrsooft on translator and the translation quality is descent. Very weird.