Hacker News new | ask | show | jobs
by rocauc 206 days ago
The model supports batch inference, so all prompts are sent to the model, and we parse the results.