[rl3]

>... but as there's no complete feedback loop, it still would require a lot of human effort.

Not for long. Picture this: a robot receives instructions on what to physically solder in order to complete the desired modification task.

However, before it can send an image back to the vision-aware LLM guiding it, the PCB lights on fire along with the robot because said LLM confidently gave the wrong instructions.

Then, the robotic fire brigade shows up and mostly walks into walls unable to navigate anywhere useful.

The future is bright.

[flemhans]

I'm already having lots of success letting the agent loose on the arduino or rpi and figuring out all the annoying i2c bits and having me try different pinout and wiring combos until it works. Even with a human in the loop agents are useful right now for electronics. On one occasion I did give it a camera feed so it could check for itself if the LEDs were doing as expected.