[woadwarrior01]

> Running deepseek 6B on the Private LLM app on the iPhone 13 basically set my phone on fire

Hey, I’m the author of Private LLM. I hope you’re joking about the phone catching fire. Btw, there’s no DeepSeek 6B model, you’re likely talking about the DeepSeek Distill 7B model.

[AndrewKemendo]

Yes thank you for the correct correction

The last model I tried to run was Dolphin 3B but even Zephyr1.6B kills the phone pretty fast even with a full battery

Even Dolphin completely killed my phone so yeah I can’t really use the Private LLM app for anything heavier than the default 1.6B

[woadwarrior01]

Yeah, I agree. Really hard to fit anything larger on the 4GB of RAM on the iPhone 13 of which, only about (depending on what iOS version you're on) 2.1-2.5GB is usable by apps.