Hacker News new | ask | show | jobs
by oneofthose 2332 days ago
DBT (data build tool) [0] embraces this idea - it's like make for data transformation. Just like make its syntax is sub-optimal. But that's the only draw-back. There is an open source version, it generates documentation automatically, you can materialize tables on a schedule, it allows you to write unit tests for your data ("this select must return 0 rows" kind of tests). I'm not affiliated with them, just happy user.

[0] https://www.getdbt.com/

1 comments

Yes, that was my first thought when I opened the article. dbt is amazing and basically converts your SELECT statements to CREATE TABLE statements.

I guess they target both EL from the ELT, while dbt relies on data being in your data warehouse.