[altmanaltman]

I think a more sane minded customer would not mind paying for the assurance and having someone to blame in case things go wrong, not necessarily because of their domain knowledge.

I could theoretically learn everything about plumbing but would still rather call a professional for the peace of mind that it was done "correctly" and it the process goes wrong, I would have an instant fix instead of trying to go back and educating myself on plumbing more.

Could you consider that as part of knowledge? Yeah and also no. Because the knowledge can be copied and put into a LLM but legally a LLM cannot sign off on things like NDAs or take accountability like a human has to in these roles.

[RugnirViking]

I agree. I also think that deciding that LLMs encode all knowledge perfectly, either now or in an imagined future, is foolish. My experience is that they match the average general state of experts among the field. The sort of thing a junior might read to start to grasp the general ideas and issues in a field. They rarely have opinions, or good intuitions around more specific scenarios. This is why the current equilibrium of a senior piloting one works so well- theyre leaning on it to speed up, but pushing it away from the "average" where circumstances demand.

We can argue about imagined future progress, but I don't see that getting much better, given that the literature doesn't often do that, and how often experts in one scenario end up being poorly suited given another set of facts.