Hacker News new | ask | show | jobs
App to Run LLMs on Android (play.google.com)
1 points by ValleZ 852 days ago
2 comments
ValleZ 852 days ago
One way to run LLM on android phone is to run ggerganov/llama.cpp in console like termux and it works quite well but is not super convenient. I was working on the app to make running on-device LLMs more user friendly, please try it out!
link
Zambyte 852 days ago
Cool project! Where is the source code for this?
link
ValleZ 852 days ago
It's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp
link