[phire]

Yes, Deepseek introduced this optimisation of a common base "expert" that's always loaded. Llama 4 uses it too.

[regularfry]

I had a sneaking suspicion that I wouldn't be the first to think of it.