[treesprite82]

Note that I'm being intentionally reductive to argue that the net buscoquadnary threw around ML models and future-telling with sheep entrails also includes the scientific method.

I do also think that ML as a field progresses through the scientific method ("I theorise that this network with residual connections will converge faster, lets see if there's a significant difference") - but maybe not to the full extent it could.

> Just trying two things at random and picking the one that makes some arbitrary metric go up, is not the scientific method. It’s gradient descent.

I'd say that's closer to evolutionary algorithms. GD finds (locally) the direction to tweak the weights to improve predictions on a given batch.