Hacker News new | ask | show | jobs
by buremba 1207 days ago
This is pretty cool! It uses Vega transforms under the hood, right? The default backend uses JS for transformation which is slow for large datasets. Did you consider using Duckdb under the hood via WASM? I run into this project but not sure how active it is: https://github.com/vega/vega-plus
1 comments
loa_observer 1207 days ago
There is a WIP PR for combining DuckDB with Graphic Walker: https://github.com/Kanaries/graphic-walker/pull/18

WASM of Graphic Walker is coming soon！

link
buremba 1207 days ago
Cool! How does it work in practice? Looking at the PR, it seems to pull all the data from Duckdb but is there any plan to apply the transformations (filter, aggregate that the user selected in UI) in Duckdb while rendering the chart?
link
loa_observer 1207 days ago
This PR had just tested running DuckDB-WASM. For more complex computation, I am planning to build a computation engine to generate SQL and push it to DuckDB or other databases. (I built a POC like this in another project, RATH, but the SQL is push to clickhouse instead.)

If you are interested in this, welcome to discuss with us in the PRs/issues on Github or in our Discord: https://discord.gg/Z4ngFWXz2U

link