[treis]

What do you think the government is like today? At least with LLMs you'd get your incorrect answer quickly and cheaply.

[adamddev1]

Human incompetence, or human-written algorithmic incompetence in code can still be identified, appealed to, and dealt with.

With LLMs you get incompetence cut off from human embodiment and any chance of empathy, baked into opaque black-boxes, and automated and scaled.

We should be arriving to build things that are correct, not saying "stuff sucks already, let's make more stuff that sucks."

[treis]

There are theoretically appeals but for the most part they're illusionary. The original decision is given a lot of deference and the appeal is almost always denied. Plus it's gated beyond a lot of time and money. In adversarial proceedings that's a weapon for one side or the other.