[doubtfuluser]

Any plans on distilling it down to an 8b model to enable it for pure local usage on most consumer hardware?

[samatdav]

Could be done in the future. Our current focus is highest accuracy. But there are no limitations on the models - just would depend on user preference of size/performance tradeoff.