Hacker News new | ask | show | jobs
by Filligree 848 days ago
They do benefit from batching; up to a 50% performance improvement, in my experience.

That might seem small compared to LLMs, but it isn't small in absolute terms.

1 comments

I got a 2x jump on my 4090 from batching SDXL.