[adamsmark]

I use my Openclaw setup to record notes I don't ever want to remember the details of. Here are some examples:

Storing my Health Insurance's Member ID, RxBin and other data. Recording the serial number of a product I will be calling technical support for. Organizing files to be more logical and deduplicating or consolidating as needed.

Whenever I want this info, I'll just ask my LLM to pull it up.

[johntash]

Do you use local models for these, or are you okay with giving private details to anthropic/openai?

(that's one of my biggest hurdles for really adopting any useful assistant type of agent)

[adamsmark]

I want to use local LLMs, and in fact I have enough VRAM (12GB) and RAM (96GB) to do it but I gave up because it was pretty buggy with the Gemma 4 26B (A4B?) Q4 models. It also meant I had to give up local voice transcription because I needed all my VRAM dedicated to the LLM.

The other thing is I will ask an agent via Telegram to code stuff, so I want an agent that is smart enough to do it all. I prefer brute forcing with money right now. I hate when LLM make bizarre mistakes, I end up spending way too much time figuring out the issue.

I use Openrouter, so hopefully no one has built a perfect replica of me in their storage. I flip between models too.

But to be clear, I am living dangerously with agentic workflows in general. Haven't been burnt yet (other than accidentally running up a huge Gemini bill which made me switch to Codex Oauth and Openrouter for cheap Minimax 2.7)

I am moving to a commander/orchestrator model to use both frontier and cheap models and eventually a better local LLM once I buy a 5070 Ti, 3090, 64GB Mac M1 Max, 128GB Strix Halo (probably missed that train) or the AMD R9700.