Hacker News new | ask | show | jobs
by riwsky 1044 days ago
Were your Disney+ fires using dbt? The comparison in your demo doesn’t resemble normal dbt usage: it forces the SQL to inline the state abbreviation instead of using a dbt seed file, while the initial serra version uses one; it initially shows the serra code-folded, to make the SQL seem more verbose; and the SQL makes no use of CTEs or dbt models, either of which would make the transform steps clear.
1 comments

These are all great points, and no, Disney didn't use dbt. We wanted the demo to show how you can modularize SQL into reusable objects that you can fully customize error logs for, while also adding the value of handling all steps of ETL in-house. You could definitely write this script modularly using dbt, but we feel like that value add of having connectors that easily integrate with your transforms (e2e), as well as taking the software engineering best practices that dbt applies a step further by turning each transform and connect into objects that you can test, modularize, and customize error logs for is our main differentiator.