Hacker News new | ask | show | jobs
by jimsparkman 1433 days ago
The slides [1] helped me grok what problems this tool solves pretty quickly.

Everything big data is moving to blob storage these days, but streaming can lead to small files problem or longer latencies. File fragments stored locally with proxied readers seems like a simple solution to that.

[1] https://gazette.readthedocs.io/en/latest/overview-slides.htm...

1 comments

Small files should be in arrow/avro/parquet if your architecture allows (one should strive for this from the beginning).