Hacker News new | ask | show | jobs
by scapecast 2129 days ago
there are always things the warehouses can't build themselves.

For example, with intermix.io, it was the tracing we had built for other tools like Looker and dbt. The insight was that the result of a DAG involves many different calculations across different tables. The metadata only tells you that the steps happened, but doesn't tell you in what sequence they happened, where the "hiccup", latency, etc.

Redshift is clearly suffering from Snowflake. I wrote about that in my post-mortem. That post also has a few battle scars:

https://medium.com/@larskamp/why-we-sold-intermix-io-to-priv...

Ping me on LinkedIn if you care to hear more :-)

1 comments

Cheers, appreciate it, will ping you on LI!