Hacker News new | ask | show | jobs
by gonzalohm 25 days ago
And you think Google, one of the biggest cloud providers, Microsoft, etc. are going to be onboard with local LLMs? I don't think so
5 comments

Not sure about Google, but these Nvidia RTX Spark machines are specifically a Microsoft+Nvidia partnership. Microsoft is actually pushing hard on Windows security primitives for agents & local AI. At BUILD this year they used the phrase "unmetered local intelligence" more times than I can count.

From their blog about the RTX Spark surface ultra

> purpose-built to develop and run up to 1 trillion-parameter frontier AI models locally

Google may not want it, but Microsoft has a ton of lobbying power, and being primarily an enterprise software and services company, they know local AI is important for their own customers, and will also be important to sustain the PC OEMs that are threatened by a move toward thin client like devices.

Not forgetting Apple!
They'll do local LLMs you have to pay for. Best of both worlds: your LLM processing power will be locked behind a subscription.

You'll be coerced into a subscription to unlock the processing power you already have, and it'll only be usable by official Microsoft, etc implementations.

They get your money, get to control you, and best of all, they don't have to run it themselves in their data centers

Have we seen this with CPU's being throttled only to have to pay a subscription for more performance? Or GPU's? Or memory? Or storage?
The obvious brain-child of this concept is HP and their consumer inkjet printers. Originally, they sold their printers for "cheap" and then sold ink for a premium. However, as consumers realized any old printer ink works just as well as "HP"'s ink, they created DRM for ink-cartridges.

Now, you have to basically use their "Instant Ink" monthly service in order to print anything, based on my understanding. $6 for 50 pages a month: https://www.hp.com/us-en/print

(If you try using non-official cartridges, the printer may refuse to print entirely. If you cancel the sub, the printer will refuse to print until you renew or find DRM ink).

LG is pushing for subscription models in their fridge line-ups: https://www.pcmag.com/news/lg-wants-you-to-subscribe-to-your...

I don't see a price for the subscription yet, but it seems they are targeting 2030 for a subscription fee lock-in.

Intel did "Intel Upgrade Service", which locked already fabricated features on a CPU behind what is equivalent to today's same-day DLC - you paid more money, got a code, and it unlocked more cache and/or hyperthreading capabilities: https://en.wikipedia.org/wiki/Intel_Upgrade_Service

The backlash in 2010 on Intel was probably severe enough to delay it significantly, but with many industries trying it out (Cameras, TV's, fridges, cars, etc.), consumers probably won't have many options left.

Google knows they will happen and even ships it with chrome.
Google ships a local LLM with chrome browser nowadays. Don't they also provide the weights for the LLM built into iOS and MacOS?
Google and Microsoft both have released a bunch of open models and research, unlike Anthropic, which does nothing but take.