[skybrian]

I wonder why anyone would want to run it in a browser, other than to show it could be done? It's not like the extra latency would matter, since these things are slow.

Running it on a server you control makes more sense. You can pick appropriate hardware for running the AI. Then access it from any browser you like, including from your phone, and switch devices whenever you like. It won't use up all the CPU/GPU on a portable device and run down your battery.

If you want to run the server at home, maybe use something like Tailscale?

[simonw]

The browser thing is definitely more for show than anything else - I used it to help demonstrate quite how surprisingly lightweight these models can be.