Hacker News new | ask | show | jobs
by oofbaroomf 415 days ago
Many models that use test time compute are MoEs, but test-time compute is generally meant to refer to reasoning about the prompt/problem the model is given, not about reasoning about which model to pick, and I don't think anyone has released an LLM router under that name.
1 comments

we dont know what OAI does to find the best answer when reasoning but I am pretty sure that having variations of a same model is part of it.