[mwc360]

Author here: that’s exactly what I was trying to communicate but you said it better :)

[cmdlineluser]

There is a Spark API[1] being built using their Relational API[2].

Progress is being tracked on Github Discussions[3].

[1]: https://duckdb.org/docs/api/python/spark_api.html

[2]: https://duckdb.org/docs/api/python/relational_api.html

[3]: https://github.com/duckdb/duckdb/discussions/14525

[mwc360]

Very cool! This seems like fantastic functionality and would make it super easy to migrate small Spark workloads to DuckDB :)