Hacker News new | ask | show | jobs
by khaledh 2534 days ago
What's the core transformation technology running the SQL transforms? Are you relying on the cloud data warehouse itself (i.e. BigQuery, Amazon Redshift or Snowflake) to run the SQL transforms? Asking because the transform workload usually dominates the query workload if they're not properly separated.
1 comments

Just from the docs, it appears to rely on the warehouse itself. It’s basically SQL + js templates make data engineers/analysts jobs easier.
Yup, the warehouse or query engine does the heavy lifting, we do the orchestration and make easier to develop these pipelines.