[SushiHippie]

Something what I'd really like, would be:

1. You have an application open, let's use for this example Apple Notes 2. You ask it to summarize the "Recipe xyz" 3. It will search for the recipe 4. Open the note 5. "Copy" the text 6. Summarize it for you

This is a very simple example and maybe not "cool" enough. But would be great to give it any kind of interface and then do some more "advanced" (for an LLM) tasks.

I think this could be possible with GPT4-Vision, but it would be very costly, for things which you could do yourself with a few clicks and key presses.