Yes, we store the historical value of each test so you can always scroll back through time and see the state of the data warehouse at any given point.
For example, if you have a test that counts the number of rows "COUNT(*)" - that value will be recorded. So you can look back an hour/day/week and see how many rows the table had without executing any SQL. These values are stored in a time series db, so querying history is fast.
Our tech stack: monolith backend in python + postgres + react. The test themselves are all SQL queries and run in the data warehouse.
For example, if you have a test that counts the number of rows "COUNT(*)" - that value will be recorded. So you can look back an hour/day/week and see how many rows the table had without executing any SQL. These values are stored in a time series db, so querying history is fast.
Our tech stack: monolith backend in python + postgres + react. The test themselves are all SQL queries and run in the data warehouse.