[builderminkyu]

tried doing exactly this with ollama on a cross-country flight last month. my macbook basically turned into a jet engine and the battery died in under an hour.

curious if you had to heavily throttle the cpu or stick to super small quants (like 4 bit phi3) to actually make it through 10 hours without a power outlet?

[julianlam]

Using an LLM to code without AC power is ... certainly a choice.

On my framework 13 a couple exploratory prompts and a code writing step drained my battery to 85% in about 5 minutes.