[shawnz]

What makes you think it's not normal that it does this? It's a statistical model that predicts the most likely response to your prompt, and the internet is full of news and references to GPT these days as well as GPT generated output, so isn't it expected that the most likely response to such a prompt might refer to GPT-3?

[zenati_]

so shall we deduct that reasoning capabilities are very bad for Mistral?

[shawnz]

I don't think this implies that. Even a human being with strong reasoning capabilities could be made to believe it were something it's not if that is all it was ever taught. This isn't a matter of reasoning.

[gremlinsinc]

according to one of the ai youtubers, the mistral large llm actually scored a perfect score on their logic benchmarks, which is pretty good. All LLM's are prone to some suggestion or confusion. I wouldn't base whether it's logical or not based off an assumption from one response.