|
|
|
|
|
|
by maxisaurus
946 days ago
|
|
|
Work a lead data in a fintech company based in EU.
I built a simple observability tool for key data assets in a data warehouse. It's a python monitor you add to a given table, it checks that table daily and tells you when there is an issue & which rows introduced that issue.
We used static testing framework like great expectations but that was not enough. We did not have the budget for the big data observability players like Monte Carlo, so we kept it simple. Repo if interested: https://github.com/data-drift/data-drift (Disclaimer: I am focusing full time on this project to see if it's an interesting business opportunity. It's 100% open-source -- feedback welcome!) |
|
|