Hacker News new | ask | show | jobs
by jjhartmann 37 days ago
For testing / experimentation. Check out the

Benchmarking Tool: https://benchmark.sipp.sh/

and

Chat App: https://chat.sipp.sh/

1 comments

Excited about the enhanced capabilities this affords PWA's
Definitely! Browsers are just now adopting the WebGPU specs and features needed to run LLMs locally. Chromium is pretty good now, with Firefox lagging behind by a few months. But I do think its the right time for devs to start experimenting and prototyping what embedded models can do, and the use cases that they can open up. I think there is a lot of new design innovations to be uncovered