Hacker News new | ask | show | jobs
by lostmsu 455 days ago
Would batch inference increase throughput further? Or does it already peak the FLOPS?