Hacker News new | ask | show | jobs
by ValleZ 667 days ago
Private AI app in play store wraps llama.cpp
1 comments

Heh I guess that's a good point. All I have is a ten year old iPhone just to run Cisco DUO for work and there seems to be no way to run llama.cpp on it even with a very small model.

Occasionally I'll use i.sh to ssh into a decent computer but it would be nice to be able to just run normal software on it.

It will probably run 2B models, there are many more options for iOS, try it out.