[Tepix]

I feel that a LLM that runs locally has its place in a modern browser. The alternative is sending your page contents to a server in the cloud with the associated loss of privacy. Of course issues like fingerprintability and vendor model lockin have to be taken into account. It seems to be too early to carve things in stone, so I agree with Brian Grinstead and the others.

[wavemode]

The alternative is that web pages just don't run inference? Why is that something a web page should expect to have a right to? If you want to burn a bunch of GPU heat, spend it on your own servers, not my computer.

Either way, if this does happen I definitely hope it gets put behind a brower permission.

[Tepix]

It already is, the first time you use it you have to download the weights and you can just abort at that point.