Hacker News new | ask | show | jobs
by jph 654 days ago
> All the most-impactful projects in the data engineering world are now written in Rust.

Is this true? I love Rust and use it daily, yet I often hear from data engineering peers that Rust has too much friction for most data engineering projects, because of the borrow checker, lifetimes, compile times, inability to express functions and traits in some ways, async futures, and ABI/FFI issues with external data processing code.

Happy to be corrected about all the above, though.

2 comments

The "article" is just a book ad with a paragraph or two of contentious stuff to hook a buy.

Don't read too much into it. (Pun intended)

if you mentally rewrite the title to “lower level data systems” instead of “data engineering” i feel like it starts making a bit more sense.

spark et al have massive continuous momentum. they’re not going anyway any time soon.