[Thanemate]

>Because AI represents the distillation of the very best human knowledge and expertise. AI is compression of human capabilities, the very best ones.

I'm confused if this is satire, sarcasm, or genuine belief. If this was the case, then AI companies should absolutely remove the "it may make mistakes", because doing mistakes would imply that "the very best human knowledge and expertise" is what actually fails, and not the AI.

With that being said, I'll still urge people to visit a professional therapist for health problems and I generally still trust human knowledge workers for critical scenarios. I will reconsider your claim when chatGPT can effectively play Yu-Gi-Oh! (or at the very least respond with the correct rules appropriately), which is a significantly lower stakes scenario than betting your entire company on its aptitude.

[aarondong]

My framing may have been confusing there. “distillation of the very best human knowledge of expertise”. Distillation is different from outright capability or reliability. It is not directly adjacent.

For anything health related all AI models show high levels of anchoring bias. I would not use it as a confidant, and be skeptical of claims. Even so, human doctors are also fallible and prone to cognitive bias.

I think the obfuscation is because human intelligence has been projected onto AI model capability. AI models only have a limited dimension of human intelligence, and in some axes orthogonal, and when I say distillation I refer to this.