Hacker News new | ask | show | jobs
by minraws 16 hours ago
so burn more tokens to save more tokens, so that we can spend more on X token but save on Y tokens?

not the question is which X tokens and which Y tokens? and since the output is non-deterministic how do you validate this?

LLMs aren't random and that enforces something that people are too dumb to realize that random-ness could be normally distributed but LLMs have no reason to be normally distributed or follow any sort of curve of understanding.

They are non-deterministic but with bias so their output might be just be worse with T' transformation for the class of problems A is solving but work great for B. or vice versa.

You can't reproducibly test LLMs and that allows all sorts of benchmarks to exist which can make any model look good or bad as much as we want. Enlightening stuff.

Not much different from sociological or psychological sciences where with enough bias in data you can prove anything.