[Fiahil]

Yet, everyone misses reproducibility and data versioning :)

So, talking about monitoring, training, and recording model drift is only a single side of the domain.

[KptMarchewa]

> Yet, everyone misses reproducibility and data versioning :)

Delta Lake/Apache Iceberg solves that.

[Fiahil]

Absolutely not.

A single vendor/tech does not "solve" anything when the task at hand implies you need to entirely re-design data pipelines, ML modelling and benchmarking.

[alfalfasprout]

LMAO no, no it doesn't and has major migration consequences for existing data warehouses.

Reproducibility is more than just upstream data versioning.

[alfalfasprout]

Not to mention dependency management! Since a lot of ML code is in Python this ends up being a very tricky thing to handle at scale (especially if you need to update dependencies, etc.)

[pharmakom]

I didn’t care much for Docker until I started working in the Python ecosystem.