Do we do things like this for other technology or for other software? Why the huge intense fear as soon as someone puts a label 'AI' on a piece of software?
It seems like a lot of people are using it to do real, actual, helpful work, especially learning about new topics. I'm not sure it's productive to call it hype at this point.
Yes, we do. It’s AI accelerationists that are the ones demanding special treatment of being able to deploy potentially dangerous technology without any regulations and without doing any work to verify and demonstrate it is safe.
Is that really special treatment ? There was no NTSB before the first train derailed and killed people. We usually wait for a new technology to kill a lot of people before we address questions of safety.
In fact, yes.
Some of them are even scarily named: https://eusprig.org/research-info/horror-stories/
It is a healthy practice to have public databases of incidents, so that others can learn from our mistakes.