[Terretta]

From the README:

Optionally, offload generation to speed up generation while extending the battery life of your MacBook.

Screenshot shows example, mentions OpenAI and gpt-4o.

[abroadwin]

But it still forces you to download a local model before you can use that feature.