|
|
|
|
|
by atomicity
2164 days ago
|
|
Nightly to seconds = developers can see the data generated
within seconds. This generally has implications on data quality, because you aren't fixing data quality issues once they occur in prod. This also makes it far easier to develop ETL pipelines. You don't need complex tooling to see whether your ETL pipeline works. You can technically fix data quality and dev velocity issues without low data freshness, but a quick glance at the data engineering landscape tells you they aren't being solved enough. |
|