[raincole]

Maybe you can try to read other comments below your original comment, as they mostly share the same point and I don't bother to repeat what everyone else has said.

I'll put it concisely:

Trying to build predictable result upon unpredictable, not fully understood mechanisms is an extremely common practice in every single field.

But anyway you think LLM is just coin toss so I won't engage with this sub-thread anymore.

[troupo]

And you should read replies to those replies, including yours.

Nothing in the current AI world is as predictable as, say, the medicine you can buy or you get prescribed. None of the shamanic "just one more prompt bro" rituals have the predicting power of physics laws. Etc.

You could reflect on that.

> But anyway you think LLM is just coin toss

A person telling me to "try to read comments" couldn't read and understand my comment.

[touristtam]

> Nothing in the current AI world is as predictable as, say, the medicine you can buy or you get prescribed.

Do you know there are approve drugs that have been put in the market for treating one ailment and that have proven to have effect on another or have been shown to have unwanted side effect, and therefore have been shifted? The whole drugs _market_ is full of them and all that is needed is to have enough trial to prove desired effect...

The LLM output is yours to decide if it is relevant to your work or not, but it seems that your experience is consistently subpar with what others have reported.

[troupo]

> Do you know there are

Yes, I know. Doesn't really disprove my point

> all that is needed is to have enough trial to prove desired effect

all that is needed lol. You mean multi-stage trials with baselines, control groups, testing against placebos etc.?

Compared to "yolo just believe me" of LLMs.

> The LLM output is yours to decide if it is relevant to your work or not, but it seems that your experience is consistently subpar with what others have reported.

Indeed, because all we have to do with those reports is have blind unquestionable faith. "Just one more prompt, and I swear it will be 100% more efficient with literally othing to judge efficiency by, no baselines, nothing".