tangentially related: if I'm already using Fivetran, DBT and Snowflake, where does Databricks fit in? From reading their marketing material, it would seem that Databricks is a full featured solution that replaces all of the above and offers everything from ingestion to ETL and even analytics. However I keep hearing of companies using Databricks alongside those other products and I don't understand how does it fit into that type of data pipeline.
Databricks is more of a platform than "just" a tool. So yes we offer first-party "end to end" solutions, and we're happy to show their value to you and convince you to pay for them, but we play nice with others, and we have a ton of great partners who can connect into our platform and help you ingest, transform, analyze, and consume your data. So you can use our native ingestion tools, or partners like Fivetran; our native ETL/ELT tools, or dbt; our native SQL/BI/warehousing capabilities, or Snowflake.
The metaphor Andy Kofoid our VP of Ops uses is XBox or Steam. They're a platform others can build things on, but they also sell their own games and offer value-added services on top of the things others are selling.
And like those platforms, we have the same ultimate twin goals of attracting customers and partners.