Hacker News new | ask | show | jobs
by datadrivenangel 914 days ago
I've helped with multiple data engineering teams that suffer tremendously due to a lack of local setup, so DuckDB and the right choice of tools looks immensely promising.

Also for 99% of companies and data workloads the optimal choice should usually be a janky bash script, so this provides meaningful competition for annoyingly medium data.

1 comments

> I've helped with multiple data engineering teams that suffer tremendously due to a lack of local setup

why remote setup is not enough for those teams?..

remote setup was enough, but our dev environments were never quite 100% the same as prod because copying all the data would have been too expensive, and the remote environments were always just a little higher latency for things than the local computers... Just a little bit worse in ways that annoyed people.