Hacker News new | ask | show | jobs
by bigfudge 1119 days ago
The embeddings can be based on a different model to the one you pass them as context to. So you could upgrade the summmariser model without upgrading the embeddings.
1 comments

But you'd need to keep both models in parallel, right? Using M1 to keep computing embeddings and using M2 for completions.