Hacker News new | ask | show | jobs
by rocauc 253 days ago
The model supports batch inference, so all prompts are sent to the model, and we parse the results.