[qsera]

This is not very surprising. The docs you write can only help if the person who is reading it have the same mental model of what ever thing that is being documented. Because the questons they want answered arises from what ever little subset of understanding they have of the thing. And this could be different for different people.

And this is why LLMs are great for looking up docs. It makes any docs work for any one as long as the information is present in the doc.

[pixl97]

Adding to this, if an LLM can't get the right answer from your docs, its your docs that are bad.

[coldtea]

Nah, it's also just as well the LLM that's not smart enough/hallucinates.

You can see it often reading the code wrongly (and the code is the canonical description of the program, no room for interpretation). Or inventing non-existent APIs. Or not being able to count the "r" in bluberries.

And suddenly, the only way for it to get the wrong idea from your docs is the docs themselves being bad?