[chris-hartwig]

Thank you for this! Local models will bring privacy at some point, and I already know an excellent use case for such a small embedding model (cheap and fast search in a product base). Relying on the CPU is also a plus in my case.

[soycaporal]

that's great! let me know if there is anyway I can support, or any specific use case a roadmap could address!