[baq]

I expect the bitter lesson to continue to be bitter. Mistral must at least attempt to catch up to SOTA 6 months ago.

[coredev_]

Do they really? "SOTA" is great for development and creating content but for industrial needs.... perhaps they are not really "SOTA"?

[baq]

It follows directly from the bitter lesson - a frontier model can be relatively cheaply distilled into anything you need to run quickly (and a frontier model like Mythos will help you distill it quickly), decidedly not true the other way around.