[matheusmoreira]

Is there a guide to running these models locally? Sonnet level inference on my own hardware would be world changing.

I have Claude but I don't want to ask it because Anthropic could decide to sabotage me.

[angry_octet]

They won't be giving this away, at least not for some years. It almost certainly has distillation data embedded in it, and that would be a smoking gun.

[matheusmoreira]

What? I just searched the web and the results say MiMo V2.5 Pro is fully open source. The weights seem to be out there.

Distillation is not a problem.

[angry_octet]

There are certainly open weights which are available, I don't know if that is what is running on the service.