Hacker News new | ask | show | jobs
by tyushk 116 days ago
Data tagging? 20k tok/s is at the point where I'd consider running an LLM on data from a column of a database, and these <=100 token problems provide the least chance of hallucination or stupidity.