Hacker News new | ask | show | jobs
by fooker 10 days ago
Running a local llm at 10 t/s overnight to extract data from a few PDFs will burn more in electricity than paying cents for the hosted kimi models.

You can (sometimes) break even if you have a workstation GPU.

1 comments

Sometimes data privacy is paramount.