[flappyeagle]

Ask 10 different models then

[pclmulqdq]

Same problem: The models are also correlated on what they can and can't solve.

To give you an extreme example, I can ask 1000000 different models for a counterexample to the 3n + 1 problem, and all will get it wrong.

[flappyeagle]

No. What a bizarre example to choose. This is so easy to demonstrate. They will all come back with the exact same correct answer

[pclmulqdq]

If it's so easy, go do it. You can publish the result in any math journal you like with just a title and a number, because this is one of the hardest problems in mathematics.

For reference: https://en.wikipedia.org/wiki/Collatz_conjecture

[flappyeagle]

My guy, every LLM has read Wikipedia

[pclmulqdq]

I don't know if you're purposely being dense. The first sentence of Wikipedia is that this is a famous unsolved problem.

So no, sampling 1000000 LLMs will not get you a solution to it. I guarantee you that.

[flappyeagle]

It will get you the correct answer, not a solution. Once again it’s a terrible example, I don’t know why you used it. It’s certainly not a gotcha