Hacker News new | ask | show | jobs
by maxmcd 231 days ago
Are there any open sourced sharded query planners like this? Something that can aggregate queries across many duckdb/sqlite dbs?
2 comments
hobofan 231 days ago
Not directly DuckDB (though I think it might be able to be connected to that), but I think Apache Datafusion Ballista[0] would be a typical modern open source benchmark here.

[0]: https://datafusion.apache.org/ballista/contributors-guide/ar...

link
mritchie712 231 days ago
DeepSeek released smallpond

0 - https://github.com/deepseek-ai/smallpond

1 - https://www.definite.app/blog/smallpond (overview for data engineers, practical application)

link