[remix2000]

Calling llm slop "hallucinating" is so counter-productive imo. After all, LLMs are just a variant of markov chains and as such this technology isn't able to discern falsehoods from truths. It's like trying to use a barometer to tell the time.

[hit8run]

You are also just a variant of markov chains wired in your brain. So what you complaining about?

[remix2000]

Well the difference here is that you're overly simplifying complex biology and many other factors whereas llms are in fact actually simple mathematical models. As always, the devil lies in the details. Dismissing intricacies is a useful tool for daydreamers, not so much for engineers.

[sometimelurker]

LLMs actually aren't simple Markov chains tho, your also simplifying. and LLMs trained with RLVR aren't just optimized over the space of functions (like gpt2 was), they're optimized over the space of programs (programs under some length). You find the ideal algorithm that can do the task you need it to.

[qwery2]

RLVR is a process which updates the Markov chain

[__natty__]

And often it’s not perfect either. Just because one is true it doesn’t dismiss the other