Hacker News new | ask | show | jobs
by JoelEinbinder 677 days ago
Temperature doesn't play a role here, because the LLM is not being sampled (other than to generate the candidate answers). Instead the answer the llm picks is decided by computing the complexity for the full prompt + answer string.