[jitl]

This is awesome! Is any of it open-source? I’d love to learn more about how the LLM works in the browser.

[_vxw6]

It will be very soon https://github.com/haystackoss/haystack

some rust code that compiles to WASM loads LLM from memory, and uses custom transformer.py like rust alternative we wrote.