Hacker News new | ask | show | jobs
by computerex 926 days ago
OpenAI API doesn't support batching afaik.
2 comments
HellsMaddy 926 days ago
They do: https://platform.openai.com/docs/guides/rate-limits/batching...
link
treprinum 926 days ago
Embeddings can be batched.
link