Hacker News new | ask | show | jobs
by zozbot234 13 days ago
Code review could also be run as an unattended/batched task though, possibly with at least some use of on-prem inference (which excels at this). That would be a major saving compared to the usual cloud inference scenario.
1 comments

with which models, though?
Yeah wasn’t there a report recently on how local models after energy costs didn’t weren’t actually more efficient to complete the same task?