[bambax]

Every experience I have had with LLMs generating code. LLMs tend to follow the prompt much too closely and produce large amounts of convoluted code that in the end prove not only unnecessary but quite toxic.

Where LLMs shine is in being a personal Stack Overflow: asking a question and having a personalized, specific answer immediately, that uses one's data.

But solving actual, real problems still seem out of reach. And letting them touch my files sound crazy.

(And yes, ok, maybe I just suck at prompting. But I would need detailed examples to be convinced this approach can work.)

[brandonchen]

I'm sure your prompting is great! It's just hard because LLMs tend to be very wordy by default. This was something we struggled with for a while, but I think we've done a good job at making Codebuff take a more minimal approach to code edits. Feel free to try it, let me know if it's still too wordy/convoluted for you.

[handfuloflight]

> LLMs tend to follow the prompt much too closely

> produce large amounts of convoluted code that in the end prove not only unnecessary but quite toxic.

What does that say about your prompting?