On the other hand: in order to be able to use current LLMs effectively, you have to understand their output well enough to debug it, even if you are using the LLM to write the fix to its own bug.
I’ve done something along the lines of “write me a python script which converts midi files into this JSON format I’m giving you as an example: …” — a few runtime crashes it was able to fix just from pasting in the command line output, but fixing “all pitches and durations are zero” required me to get my hands dirty and decompose the problem into a chunk small enough for chatGPT to fix.
I don’t know how far we are from any AI, LLM or otherwise, not needing or benefiting from human oversight, except in the specific domains like chess where it has already happened. I don’t believe in saying “never” to stuff like this, as that’s a common error with many technologies from flight to superconductors not just AI, but I also notice my personal guesses err on the side of being too near in our future.
On the other hand: in order to be able to use current LLMs effectively, you have to understand their output well enough to debug it, even if you are using the LLM to write the fix to its own bug.
I’ve done something along the lines of “write me a python script which converts midi files into this JSON format I’m giving you as an example: …” — a few runtime crashes it was able to fix just from pasting in the command line output, but fixing “all pitches and durations are zero” required me to get my hands dirty and decompose the problem into a chunk small enough for chatGPT to fix.
I don’t know how far we are from any AI, LLM or otherwise, not needing or benefiting from human oversight, except in the specific domains like chess where it has already happened. I don’t believe in saying “never” to stuff like this, as that’s a common error with many technologies from flight to superconductors not just AI, but I also notice my personal guesses err on the side of being too near in our future.