Hacker News new | ask | show | jobs
by AndrewKemendo 105 days ago
Yes thank you for the correct correction

The last model I tried to run was Dolphin 3B but even Zephyr1.6B kills the phone pretty fast even with a full battery

Even Dolphin completely killed my phone so yeah I can’t really use the Private LLM app for anything heavier than the default 1.6B

1 comments

Yeah, I agree. Really hard to fit anything larger on the 4GB of RAM on the iPhone 13 of which, only about (depending on what iOS version you're on) 2.1-2.5GB is usable by apps.