[intrasight]

Is that true? If the distillation is not lossy and the model runs much faster due to less resource consumption, then it may outperform.

[mwigdahl]

One of those conditionals is a pretty huge assumption.

[intrasight]

It's an assumption and it can be tested