Hacker News new | ask | show | jobs
by poorman 1968 days ago
Not only in between processes, but also in between languages in a single process. In this POC I spun up a Python interpreter in a Go process and pass the Arrow data buffer between processes in constant time. https://github.com/nickpoorman/go-py-arrow-bridge
1 comments

How is this any better than something like flatbuffers though?
For one, Arrow is columnar.

The idea of zero-copy serialization is shared between Arrow and FlatBuffers.

This is explained in the FAQS for Arrow, saying they use flatbuffers internally. Arrow supports more complex data types
> saying they use flatbuffers internally

Only for IPC support - Arrow data format does not use flatbuffers.