[enormousness]

Accountants have specialized domain knowledge (laws, regulations, procedures, bureaucracy etc.) that goes well beyond what a calculator can do.

If we apply the same argument to software engineering I think it's a good point... just maybe not the one you intended to make.

[Yokohiii]

Learning a company and it's product is so natural to us that we hardly talk about it. It's a key skill for reliable workers.

It's probably impossible for LLMs to learn and apply that wisdom reliably.

[HDBaseT]

Why?

Humans learn this information from documentation and being exposed to all the different systems.

We know LLMs can ingest documentation like a sponge and access all different internal systems, resources and products via MCP Servers?

[Yokohiii]

Of course they can, but if you give a LLM a specific rule, what happens is that it only shifts the probability of following the rule. Prohibiting a rule violation is technically impossible via prompting.

Humans do make mistakes or forget things as well. We learn to not rush on stairs and to not touch hotplates. A few bruises later that wisdom is permanent, at some point we don't even need to fail with everything to accept the rules.

A LLM is permanently at risk to break every given rule.

[ai_brain_rot]

I think humans learn this from much more than documentation.

We learn it from conversations with our managers and peers. We learn it from reading between the lines of those conversations. We learn it by being in meetings and seeing who is reliable and who isn’t. Etc.

LLMs do great learning from documentation, but so much of what it takes for an employee to be successful isn’t and can’t be documented

[techblueberry]

> Humans learn this information from documentation and being exposed to all the different systems.

Do you work for the one company with reliable up-to-date documentation? If so you might be biased in your assessment.