[_vertigo]

All of your examples are tools that incrementally improve upon what came before and, importantly, still require the user to have an understanding of and experience with the underlying skill.

The risk being posed here is that AI may not land as an incremental improvement that still requires the user to maintain some understanding of the underlying skill.

We aren’t quite there yet with the current LLMs. You still need to have a base level of knowledge to use them effectively. But if they were just a little bit better, hallucinated just a little bit less, the value of actually knowing things goes way down.

What would the incentive be to learn the underlying skill or area if the LLM can handle things just fine on its own? Why not just let the LLM figure it out and do it? And at that point, it ceases to be a tool and starts to be something you are completely dependent on. That is a risk.