Y
Hacker News
new
|
ask
|
show
|
jobs
by
Filligree
848 days ago
They do benefit from batching; up to a 50% performance improvement, in my experience.
That might seem small compared to LLMs, but it isn't small in absolute terms.
1 comments
ls612
848 days ago
I got a 2x jump on my 4090 from batching SDXL.
link