[izoow]

I still have very mixed feelings about using LLMs to learn about things. When it works and produces valid information, it's absolutely amazing, and I find it much easier to find and grasp things than simply googling and reading through various pages hoping to piece together what I'm looking for. The problem is that a lot of the time it doesn't, and it's such a convincing liar that it's hard to tell, especially when you don't already have comprehensive knowledge about the subject at hand.

[happycube]

I'm finding that the stronger the LLM, the farther the 'frontier' of obscurity before it hallucinates gets. Mistral-7B-instruct is nice to talk to, but it's pretty easy to come up with a topic that it knows nothing about. ChatGPT4 is a lot better, but past a certain point it'll start going wonky too.

For learning to code I suspect that with a strong enough version of GPT a new user won't hit the limits, and if it goes wrong having to debug isn't a bad thing ;)

[Salgat]

I'm having this issue currently with Elasticsearch and Opensearch. I use libraries for both (since we're in the middle of migration) and not only does it conflate the two, but it even confuses versions of Elasticsearch that have breaking changes, so it ends up recommending all this convincing code that is based on non-existent or wrong-version library APIs. Drives me nuts.

[jstarfish]

Anything to do with Powershell/Azure is this x1000. It constantly recommends libraries that do not exist, to call API endpoints that were deprecated or never existed. It's maddening.

I wish more interfaces supported intake of PDFs/URLs/HTML content as domain material. Then at least we'd be able to point the bot at the most current docs and have it most-heavily weight that information.