The Windows 98 license actually did forbid using Windows in nuclear power plants (along with other high risk areas). That was due to some interaction with the Java license and I always considered it a very fortunate fluke.
I’m sure it’s printed out and put in a 3-ring binder, but why wouldn’t the instructions for “what to do when the primary coolant loop pressure drops” be in a Word document somewhere?
In all seriousness, it’s only a matter of time before an LLM makes a critical error in language-translating (or even being used to write) a reference manual for an industrial process, and escapes the attention of regulators. One can only hope that that process is not nuclear…
I’m not sure we’ll notice an increase of these kinds of things. There was a case well before AI where a process chemist replaced propylene glycol with ethylene glycol in over-the-counter medicine and a bunch of people died.
Ah, where did that carefree time go, where we had the time to read licenses...