Hacker News new | ask | show | jobs
by engineer_22 5 days ago
In safety critical jobs nobody is trusted, everything is verified. And there is someone checking the checker.
1 comments

This is not always true - e.g. gas engineers and electricians do safety critical work every day without supervision, and we trust them to do so because they are certified and they are held responsible for failures.

The same standards of care and responsibilty cannot be applied to LLMs, and asking one about electrical safety or medial issues is very similar to googling and trusting the results.

I get that people here want to believe, but the op is far too trusting of LLMs and using them in domains where it is highly inappropriate.

> Of course you should trust a human if that is their job

I’m telling you, in industries dealing with high energy, they DO NOT trust people just because it’s their job. THEY CHECK. Just like people should CHECK the LLM. I think we agree that LLM cannot be trusted. But where we don’t agree is “trust the experts because they’re humans” - that’s not an argument it’s a troll.

> gas engineers and electricians do safety critical work every day without supervision

This simply isn’t true. Electricians work is inspected before being placed into service. Engineers work is reviewed internally and permitted externally before going to construction.

It certainly is true, from experience.

You’ve never actually hired an electrician or gas engineer to work on your house have you?

Also it’s not trust the experts because they are humans but trust the experts because they are experts.