Hacker News new | ask | show | jobs
by _heimdall 733 days ago
Caching definitely helps, I agree there's no way Google would be wasting so much re-running every search token through Gemini.

That said, it's still worth calling out that their Gemini answers use drastically more resources whenever they are run and cached. We'd have to know Google's caching rules and the average frequency of cache hits to know how much it actually reduces the Gemini resource usage.

1 comments

Yes, but all this compute is great for Google's Cloud Business revenues!
Smort. Monopolies gonna monopoly.