[triska]

Expanding on this, particularly regarding causal reasoning and rules, what I find especially puzzling is the desire to apply deep learning even in cases where the rules are explicitly known already, and the actual challenge would have been to reliably automate the application of the known, explicitly available rules.

Such cases include for example the application of tax law: Yes, it is complex and maybe cannot be automated entirely. However, even today, computer programs handle a large percentage of the arising cases automatically in many governments, and these programs often already have automated mechanisms to delegate a certain percentage of (randomly chosen, maybe weighted according to certain criteria) cases to humans for manual assessment and quality checks, also a case of rule-based reasoning. Even fraud detection can likely be better automated by encoding and applying the rules that auditors already use to detect suspicious cases.

The issue today is that all these rules are hard-coded, and the programs need to be rewritten and redeployed every time the laws change.

[tachyonbeam]

There's a perception in the DL field that encoding things into rules is bad, and that symbolic AI as a whole is bad. Probably because of backlash following the failure of symbolic AI. IMO the ideal is somewhere in the middle. There are things you want neural networks for, and there are also things you probably want rules for. The big advantage of a rule-based system is that it's much more predictable and easier to make sense of.

It's going to be very hard to engineer robust automated systems if we have no way to introspect what's going on inside and everything comes down to the neural networks opinion and behavior on a large suite of individual tests.

> The issue today is that all these rules are hard-coded, and the programs need to be rewritten and redeployed every time the laws change.

The programs are probably not being rewritten from scratch. I would argue that: the laws are, or basically should be, unambiguous code, as much as possible. If they can't be effectively translated into code, that signals ambiguity, a potential bug.

[ethbr0]

I wasn't alive in the 70s, but it feels like there's a counter-bias against expert systems borne out of those failures.

"If you're putting in rules, you're don't know how to build models."

But that's probably the difference between people having success with "AI" and banging their heads against the wall: do what works for your use case!

[MikeDelta]

I have once seen an AI tool to determine what needed to be reported.

I found this remarkable, as there were clear (yet complex) rules on what needed to be reported, otherwise even the regulator wouldn't know what it was supposed to check.