Hacker News new | ask | show | jobs
by arccy 407 days ago
better compression https://opentelemetry.io/blog/2023/otel-arrow/

You don't do high performance without knowing the data schema.

1 comments

Is Arrow better than Parquet or Protobuf?
Arrow is an in-memory columnar format, kinda orthogonal to parquet (which is an at-rest format). Protobuf is a better comparison, but it's more message oriented and not suited for analytics.
Not having to write to disk is great, and zero-copy in memory access is instant...
the blog post comparison is against OTLP which is protobuf