[fg137]

I would very much like not to have to download 22 GB for some inference capability that is way worse than API calls both in terms of quality and speed.

I would rather pay money than seeing this thing running in my browser that only prints 5 tps on high-end consumer hardware.

[jfoster]

Why are you pretending those are the options?

The options are:

1. 22GB per website

2. 22GB per browser

3. 0GB / No AI capabilities

By having this in Chrome they are simply ensuring that option 2 replaces option 1. You still have option 3.

[fg137]

No. The real options are

1. No AI

2. AI that works and is actually useful

3. AI that is slow, crappy and hallucinates all the time

I choose 1 and 2.

[jfoster]

Fair, but actually you'd surely want your choice of those three, right?

And what's being discussed here is what the better implementation of option 3 is.

My point is that if you're going with one of the possible implementations of option 3, then 22GB per browser is objectively a lot better than 22GB per website.