[thereddaikon]

The last time I used an LLM I asked it to modify a splunk query for me. The result wouldn't work so I gave it feedback. It was still wrong. I tried coaching it a few times but it couldn't make it work and by that point I had spent more time telling the LLM how to write a splunk query than I would have spent doing it myself.

[inanutshellus]

Yep, I had a similar thing happen. I asked it to give me a set of regexes and after spending a couple minutes trying to correct it, I just wrote the script myself. It's neither useless nor the all-seeing eye. Instead, it's just a tool.