[anyg]

Couldn't we get a low-res version of this info by tracking the active window using a cli tool? For linux, there are several options. Not sure about Mac.

Another approach is to run OCR on 1FPS screenshots. Everything runs locally without draining the battery like an LLM would.

[jerryliu12]

You definitely could! I think it would just be harder to get good semantic understanding of what you did during a segment of time without LLMs.