|
|
|
|
|
|
by joaogante
1071 days ago
|
|
|
> Couldn’t someone say prototype the entire product on some lower-quality LLM and occasionally pass requests to GPT4 to validate behavior? It can be done -- it is the basis for assisted generation and related work. It does require full access to the model, to be time and money-efficient. See https://huggingface.co/blog/assisted-generation Disclaimer: I'm the author of the blog post linked above. |
|
|