[rudedogg]

Their rule of only releasing major software updates once a year in June is holding them back IMO. Their local LLM apis were dated before macOS/iOS 26 was even released. Just because something worked 20 years ago doesn’t mean it works today, but I’m sure it’s hard to argue against a historically successful strategy internally.

[aurareturn]

Huh? What local LLM apis? It uses Metal.

[rudedogg]

The application development APIs, ie: https://developer.apple.com/documentation/technologyoverview...

[aurareturn]

Any serious LLM work isn't going to use that. They'll use Metal GPU. No one is going to inference using the NPU on a Mac.

OP said "work stations" which is implying Macbook Pros and Studios.

[rudedogg]

> Any serious LLM work isn't going to use that.

That’s my point.

One would expect the platform owner (especially one where they own both the hardware AND software) to provide a reasonable / easy path to using LLMs if they are going to provide a framework for doing so. But Apple can’t because of how slow they ship updates