Hacker News new | ask | show | jobs
by chrsw 35 days ago
I'm struggling to understand why anyone would think Google is doing this for user's privacy. I admit I haven't dug into what's going on here in detail, but my first reaction was Google is running a small model on the user's side because it's doing things that _can_ be done on the user side and they don't want to waste their own compute to do it on their server side. I'm pretty sure whatever this thing is doing, Google can easily beam up some small amount of data, have a model churn on it and spit back the result to the user's browser. But why do all that if you can just run some small inference on the user's device?