Hacker News new | ask | show | jobs
by exsmelliarmus 1679 days ago
Seems pretty good to us! Can you give more information?
1 comments

As people noted elsewhere, you have to be VERY careful with using databricks for a full data warehouse due to the fact that it drives you to notebook driven development and scheduling of those notebooks when data pipelines should follow similar development practices as other software projects.

Great for proof of concepts, but when you start to build out complete pipelines please look into how to make the pipelines more sustainable and maintainable.