Y
Hacker News
new
|
ask
|
show
|
jobs
by
jgraettinger1
1944 days ago
Exactly. You can have the amortization benefits of batching without adding extra latency, if you do optimistic pipelining. It's super powerful if your transaction sizes aren't linear, e.g. because you're doing in-memory aggregations.
Gazette consumers use this strategy:
https://gazette.readthedocs.io/en/latest/consumers-concepts....