Hacker News new | ask | show | jobs
In-browser LLM inference engine with WebGPU and OpenAI API (blog.mlc.ai)
16 points by CharlieRuan 734 days ago
4 comments
crowwork 734 days ago
Comes with ability to do full structured generation with json schema

also a in-browser demo https://chat.webllm.ai/

link
leshenj15 734 days ago
So cool. No more privacy concerns!
link
ruihangl 734 days ago
It's good to see that it contains the standard OpenAI API interface in JavaScript which looks very convenient.
link
cyx6 734 days ago
AMAZING!
link