[attogram]

Nice. But kinda specific to using outside LLMs. No mention of using LLMs locally, which could make privacy much easier.

[deepanwadhwa]

100% agreed. Using LLMs locally is the gold standard but not everyone has the infra for that (not yet at least).