| ChatGPT isn't wrong. Imagine putting two newspaper headings on the shelf at your local drugstore that happen to spell out an incorrect headline when combined. (Or put two browser windows together with a similar effect). This is not wrong, your understanding of what it means is wrong. Sort your perspective out and you're fine. 1. LLMs are working as expected. 2. https://beta.openai.com/docs/guides/fine-tuning/case-study-i... 3. More complicated - probably not. It mostly just needs more data with specific training on domain specific areas. Take any field and generate some wrong completions from the data available and some right completions and the output tends to get better. Train it in the opposite fashion and it gets worse. The meat of this comes back to people see ChatGPT as changing its response as an indication of understanding, but it's not. Users are just adding extra constraints on what parts of the language model the model uses to generate text. This is not the same thing. An (perhaps poor) example of that might be where you're deciding to buy a tool that might solve a problem that you have. Evaluating whether it does solve the problem you decide that it doesn't. But then you evaluate whether you can afford the tool based on your budget and you decide you can, so you buy the tool. You haven't changed your mind, you've just constrained the reasons that you're using to evaluate the choice (electronic musicians often refer to this as GAS - Gear Acquisition Syndrome). TL;DR: Stop Anthropomorphizing Language Models |