[groodt]

Data Platform Group lead at Canva here.

There are many open and commercial options for hyperparameter optimization.

We didn't select Argo for hyperparameter optimization. The situation is that because we already used Argo for our ML training and data processing jobs, we wanted to see if it could be extended for hyperparameter optimization. It actually can!

As mentioned briefly in the article, we try to use tools with minimal overlap. It's not always possible of course and sometimes new tools are necessary.

[dark_pattern]

One of the authors here.

Just to add: the MLOps ecosystem evolves very quickly.

Tools that were once favored before can become obsolete very quickly. The general philosophy is to keep a constrained and minimal toolset: if we have a general purpose tool that could be extended to other cases too, then we do that. Moreover any introduced tool has tradeoffs not always apparent: additional staff training and maintainence costs.

That being said, it'd be interesting to see how the space evolves over the next few years. I think we'll eventually see best practices arising from the space, but for now it's very nascent.