I find it quite insulting that you seem to think that non-native english speakers are incapable of reading the outputs of LLMs to asses if it still means what they intended to say.
Telling me you're insulted by my comment makes me question whether it is worth the time to reply. In the spirit of goodwill, let me provide some context that your emotional response might not have given you time to consider:
I work in a multilingual healthcare field and my output is often translated into different languages. Forms. Posters. Take-home advice following surgery. We provide all of this in every language where more than about 5% of customers speak that, so English, Vietnamese, Korean, Spanish, Tagalog and Mandarin.
In addition to English, I speak and read one of these other languages fluently and have since I was about 9 years old, but I don't live in the culture and don't understand the conveyed meaning of translated health-related phrases.
Do you think I use an LLM or an editor that does? No–because that would be silly and could convey information incorrectly to the audience who can only speak that language.
If you want to be quite insulted, turn on the news and get a realistic perspective on what is going on in the world. The people hurt by text going through LLMs is going to be those in extreme poverty and minorities subjected to machine generated translations without human review. You're fighting on a site where most of us would likely be on the same side of so many issues. Let's discuss and not make this facebook full of thoughtless responses.
Especially because it's so much easier to understand text than to produce it. I can read difficult authors in a foreign language and understand perfectly but there's no way I could write like them.
This just tells me you don't work with multiple languages very often.
I have spoken a second language fluently since about 9. I produce work that is translated into that language regularly... by a translator.
Being able to read words does not means I understand the meaning they convey to a person who only speaks that language. These are scientific papers we're talking about, conveyed meaning is valuable and completely lost when a non-native speaker publishes machine generated output that the writer could not have written themselves.
These are scientific papers we're talking about, typically written by non-native speakers to a primarily non-native audience. Scientific writing practices have evolved over a long time to convey meaning reliably between non-native speakers. You are supposed to write directly and avoid ambiguity. To rely on literal meaning and avoid idioms used by native speakers. To repeat yourself and summarize.
Based on what I've seen, LLMs can write scientific English just fine. Some struggle with the style, preferring big pretentious words and long vague sentences. Like in some caricature of academic writing. And sometimes they struggle with the nuances of the substance, but so do editors and translators who are not experts in the field.
Scientific communication is often difficult. Sometimes everyone uses slightly different terminology. Sometimes the necessary words just don't exist in any language. Sometimes a non-native speaker struggles with the language (but they are usually aware of it). And sometimes a native speaker fails to communicate (and keeps doing that for a while), because they are not used to international audiences. I don't know how much LLMs can help, but I don't see much harm in using them either.
This just reminds me to never assumes someone's reality. I speak more than two languages. And I disagree.
Papers are read by all type of people, I don't know why you assume scientific papers which are almost all written in English are read solely by native English speakers.
People have been doing science in broken English, French, German, Arabic, Latin and more for as long there has been science to be made.
Sounds like you would be a perfect person to help clear up misunderstandings in texts being translated if your skills are as keen as you describe.
You mention being reminded not to assume someone else's reality by our conversation--I would encourage you to also be reminded of the common fallacy where people wildly overestimate their own abilities, especially when it comes to claiming to speak/read/write multiple languages with knowledge akin to a native speaker.
It is unfortunately very common to mislead oneself about abilities when you haven't had to rely on that skillset in a real environment.
I would venture that you don't regularly work with multiple languages in your work outputs, or you would have likely received feedback by now that could help provide understanding about the nuances of language and communication.
If you disagree with the assertion that people generally have an easier time understanding language (correctly or not) than producing it, that's one thing and that's fine. But if you consider it a claim outright, and find it incorrect, then that's gonna need some beyond-anecdotal supporting evidence, or you should ask for some from the other side. Digging into each others' backgrounds is not this.
Keeping to anecdotals and opinions though, I only speak one foreign language sadly, that being English, but this effect is very familiar to me, and is also frequently demonstrated and echoed by my peers too. Even comes up with language loss, not just language learning. Goes hand-in-hand with reading, writing, listening, and speaking being very different areas of language ability too, the latter two being areas I'm personally weak in. That's already a disparity that a cursory read of your position says shouldn't exist (do correct me if I'm misinterpreting what your stance is though).
And all this is completely ignoring how even the native language output one produces can be just straight up wrong sometimes, and not faithful to intentions. I've been talking about it like there's a finish line too, but there really isn't. This is why things like mechanized math proofs are so useful. They are composed in formal languages rather than natural ones, enabling their evaluation to be automated (they are machine-checkable). No unintended semantics lost or added.
> If you disagree with the assertion that people generally have an easier time understanding language (correctly or not) than producing it, that's one thing and that's fine.
I disagree with the assertion that a person should rely on an LLM as part of their ability to publish in a language they don't understand well enough themselves to complete without involving a word machine.
> Digging into each others' backgrounds is not this.
I spoke from experience and it was then skewered by someone cosplaying the duolingo owl on the internet. You can take it up with them if you have an issue.
> And all this is completely ignoring how even the native language output one produces can be just straight up wrong sometimes, and not faithful to intentions.
How does the inability you point out of even a native speaker to clearly and effectively communicate sometimes not simply make it more obvious that a person less familiar with the language should involve a person who is?
I don't have academic paper publishing peers with bad language skills, but I do have colleagues with bad language skills, and the misunderstandings and petty catfights they get themselves into over poorly worded sentences, missing linguistic cues, and misinterpretations, is utterly bonkers.
All otherwise perfectly smart capable people, they just happen to have this as a gap in their skillset. And no, they don't notice if transformative details get added in or left out.
> I do have colleagues with bad language skills, and the misunderstandings and petty catfights they get themselves into over poorly worded sentences, missing linguistic cues, and misinterpretations, is utterly bonkers.
Is this a widespread systemic issue within the organization, or do you work somewhere large enough that it is easy to find examples like this due to the number of people involved?
If it is the former, I would not want to work somewhere that people get into petty catfights over editing and have no abiity to write a sentence or understand linguistic cues. I don't remember working anywhere I would describe in the way you do in your second paragraph.
> And no, they don't notice if transformative details get added in or left out.
I guess I don't have to tell you not to select them as the people to review your work output?
Again, all the examples I'm reading make me think it would be beneficial for folks to include competent team members or external support for projects that will be published in a language you don't speak natively.
> Is this a widespread systemic issue within the organization, or do you work somewhere large enough that it is easy to find examples like this due to the number of people involved?
Can't tell you for sure (would require me to have comprehensive knowledge of the language skills around the company). I do know a few folks with proper language skills, but they're a rarity (and I treasure them greatly). Could definitely be just my neck of the woods in the company being like this.
> If it is the former, I would not want to work somewhere [like that where] (...)
Yeah, it's not great. The way I solved this was by simply not caring and just talking to them in proper English, hammering them until they provide me (and each other) with enough cross-verifiable information that thus definitely cannot be wrong (or will be wrong in a very defendable way), with an additional serving of double-triple checking everything. Some are annoyed by this, others appreciate it. Such is life I suppose.
> I guess I don't have to tell you not to select them as the people to review your work output?
I don't really have a choice. I think you might misunderstand what it is that I deliver though. I work with cloud technologies, so while I do sometimes deliver technical writing, most of my output is configuration changes and code. When I speak of language barrier issues, that's about chat, email, and ticket communications. I think that's plenty bad enough to have these kinds of troubles in though, especially when it's managers who are having difficulties.
Not a fixed contract, so when either side terminates it (I understand the question was rhetorical). Where I live, opportunities are not so plentiful, though I am working on polishing up my CV to compensate. Benefits are decent though, can WFH all the time, so that's also a consideration. Most everywhere they're doing the silly hybrid presence thing now, which would suck (back and joint issues don't mesh too well with having to move around in the office and travel back and forth every (other) day) - maybe moreso than the linguistic landscape that at this point I'm fairly used to.
This hesitance to switch is definitely put to the test a lot these days though :)
I work in a multilingual healthcare field and my output is often translated into different languages. Forms. Posters. Take-home advice following surgery. We provide all of this in every language where more than about 5% of customers speak that, so English, Vietnamese, Korean, Spanish, Tagalog and Mandarin.
In addition to English, I speak and read one of these other languages fluently and have since I was about 9 years old, but I don't live in the culture and don't understand the conveyed meaning of translated health-related phrases.
Do you think I use an LLM or an editor that does? No–because that would be silly and could convey information incorrectly to the audience who can only speak that language.
If you want to be quite insulted, turn on the news and get a realistic perspective on what is going on in the world. The people hurt by text going through LLMs is going to be those in extreme poverty and minorities subjected to machine generated translations without human review. You're fighting on a site where most of us would likely be on the same side of so many issues. Let's discuss and not make this facebook full of thoughtless responses.