Unfortunately Apple appears to be blocking the use of these llms within apps on their app store.
I've been trying to ship an app that contains local llms and have hit a brick wall with issue 2.5.2
In case someone don't know, this is the full text:
> 2.5.2 Apps should be self-contained in their bundles, and may not read or write data outside the designated container area, nor may they download, install, or execute code which introduces or changes features or functionality of the app, including other apps. Educational apps designed to teach, develop, or allow students to test executable code may, in limited circumstances, download code provided that such code is not used for other purposes. Such apps must make the source code provided by the app completely viewable and editable by the user.
I think Apple will become increasingly draconian about LLMs. Very soon people won't need to buy many of their apps. They can just make them. This threatens Apple's entire business model.
But… why would I put the effort into getting an llm to make me an app when a there’s an existing app that I don’t have to maintain? I don’t want to have to make every app I use?
There's a huge difference between local apps that cost one time 3-10$ and apps that ask for a subscription between 5 to 20$ per month. the first category will remain and might become more popular as quality increases, the second category will be oblitereated as the value isn't there, even if all the buyers are rich. The second group takes up a much larger part of the pie than the first though, so apple's revenue will decrease.
It depends on the value of your time relative to the price of the application. Many of us here are well paid and time poor. It makes sense to pay for well built apps. For the world, we are truly the top 1%. 99% of people would be happy to spend a few hours building an app they need to occasionally maintain. Especially if the app is subscription based.
We should also remember that the effort of building and maintaining apps is dropping precipitously as LLMs get smarter, faster, and cheaper. OpenClaw signalled the direction in which we're heading, and within a year, Anthropic will no doubt have cheap and competent agents which can handle the maintenance autonomously in the background.
> 99% of people would be happy to spend a few hours building an app they need to occasionally maintain. Especially if the app is subscription based.
With people slowly abandoning dedicated computers they fully control (if we can even call windows/macOS that) and going towards mobile/tablet computing more every year, which is a far more locked down device run by companies that are becoming increasingly hostile to “side-loading,” I just don’t see how this can become reality.
I guess I am not seeing why would I want to abandon most (if any) of my simple, small, purpose-built apps that always do the exact thing I want for a private company’s ever-changing LLM that will approximate what I’m asking and approximate its response utilizing far more resources.
I’m sure there are things on my phone it could replace (though I struggle to think of them) but there are plenty it can’t. My black magic camera app, web browsers, local send, libby/hoopla…
I can’t really think of any apps I use every day - or every week - that an LLM would replace. I’m not coding on my smartphone and aside from that an LLM is basically a more complex, somewhat inconsistent search engine experience right now for most people. Siri didn’t replace any of my apps, for instance. Why would chatGPT?
TL;DR: what apps would an LLM replace on my iPhone?
Though of course Apple's rules aren't always consistent, I have 2 separate apps currently on my phone that can/are running this (Google's Edge Gallery and Locally AI)
I disagree. My iphone app ships with an ANE optimized LLM that runs fully offline. Sailed straight through the App Store review same day after only one minor correction. It could be possible that Apple gives apps that use LLMs for it's core functionality a pass as long as it has nothing to do with vibe coding. The recent removal of the the Anything Vibe code app supports the thesis that Apple wants to prevent a flood of Ai slop apps; at least in theory as Apple can't block people from building with Claude Code & Co.
> 2.5.2 Apps should be self-contained in their bundles, and may not read or write data outside the designated container area, nor may they download, install, or execute code which introduces or changes features or functionality of the app, including other apps. Educational apps designed to teach, develop, or allow students to test executable code may, in limited circumstances, download code provided that such code is not used for other purposes. Such apps must make the source code provided by the app completely viewable and editable by the user.
Why is this related to local LLMs in app?