Hacker News new | ask | show | jobs
by ako 55 days ago
Opus and Gpt are generic LLMs with knowledge on all sort of topics. For specific use cases you probably don't need all the parameters? Suppose you want to generate code with opencode, what part of the generic LLM is needed and what parts can be removed?
1 comments

we're already doing that, it's called distillation and how models like deepseek are trained.