Hacker News new | ask | show | jobs
by esafak 960 days ago
Reminder that you can use Fugue as a unified API and swap out back-ends, including DuckDB: https://fugue-tutorials.readthedocs.io/tutorials/integration...
1 comments

Fugue,

> Fugue provides an easier interface to using distributed compute effectively and accelerates big data projects. It does this by minimizing the amount of code you need to write, in addition to taking care of tricks and optimizations that lead to more efficient execution on distrubted compute. Fugue ports Python, Pandas, and SQL code to Spark, Dask, and Ray.