Hacker News new | ask | show | jobs
by lostmsu 408 days ago
Would batch inference increase throughput further? Or does it already peak the FLOPS?