| > To be honest I thought the 'thinking' was the model being asked 'how did you come up with that' and then it generating a plausible explanation. This evades an easy yes or no, so: 1. Many consumers believe reasoning-models allow that kind of question to be truthfully-answered, and their belief it reasonable given the marketing going on. 2. Implementers probably do not have the same belief when it comes to the terms mean or what capabilities they imply. 3. Yes, it doesn't actually do what the customer wanted it to do, which is a kind of retrospective introspection of internal thoughts and ideas. ____________ I advocate looking at everything from a document-generation perspective to cut down on traps and cognitive illusions. The "reasoning" models are a change in the style of document being iteratively-grown by the LLM, as opposed to something more anthropomorphized. * Default: There's just the spoken dialogue between a Human Customer and Helpful Chatbot. * "Reasoning": There's the spoken dialogue and a bunch of times the Helpful Chatbot character has an internal monologue. This provides more consistency between iterations, and can be mined by custom tools to call external code and insert results. If your Human Customer character ask "Why did you say that", the LLM does not engage in a different process than "I have eaten an apple." The LLM has no memories to consult or hidden goals to contemplate, it's the same process of finding more stuff that fits at the end of the document. Any benefits from a "reasoning model" is the LLM generates much better-looking additions because there's more (hidden) stuff for it to confabulate against. |