Hi all I am one of the co-authors to this project, and will try to answer all the Qs here.
Was just forwarded this link - one of the community members must have posted it.
Interesting effort. Does it snapshot the state of source code at the time an experiment is run? Does it do it without requiring a git commit? I believe the Replicate experiment tracking tool does this.
We have got similar requests couple of times and its in the pipeline. Currently focused on the comparison of 1000s of metrics/training runs. It's a serious challenge both on the Ui and on the storage end.
Inviting you to the Aim [slack channel](https://slack.aimstack.io/).
We would love to learn more about such use cases and why they are important.