[cs702]

Make sure to watch the embedded video.

A new permanent taskbar button opens an OpenAI LLM trained to use Windows 11.

You ask the LLM to do what you want -- "summarize this email and send the summary to my boss."

It works with all applications. It sees what you're seeing.

As a longtime Linux user, it pains me to say this:

It's... beautiful.

...

But it's also scary, because it's not under your control. Ultimately, it obeys only the bureaucracy at Microsoft.

In that sense, it's like "MOTHER" in Ridely Scott's Alien and "HAL" in Kubrick's 2001: A Space Odyssey.

[creatonez]

> It works with all applications. It sees what you're seeing.

Sounds like it will also see prompt-injection malware hidden in plaintext documents.

[TeMPOraL]

Oh yes. This is going to be glorious to watch. Before, prompt injections were mostly a joke. With this, they will truly become a proper, new type of attack vector.

[tyfon]

This sounds like a massive security hole to me, especially if this runs in the cloud. Is this thing sending _all_ context of the programs on your windows computer to MS?

I'm also a bit curious how they will actually pay to have millions of these LLMs running and how much co2 it will output. This doesn't exactly fit their narrative about the new power saving features in their consoles.

[blibble]

> But it's also scary, because it's not under your control. Ultimately, it obeys only the bureaucracy at Microsoft.

perfect summary of modern Windows

[IceWreck]

I would love this in Linux, but only if it works offline. Not a fan of sending everything I do to a remote machine.

[causi]

Having spent most of my ChatGPT time trying to get it to correctly write powershell/batch scripts to do different things in Windows, I will be fucking amazed if this button actually does half the things you tell it to.

[kazinator]

The problem is you're a programmer. It will work right if a non-programmer does the prompting. How else do you think you're gonna be replaced?

[Gijs4g]

Yes, I really want OpenAI observing all my actions closely and 'taking notes' of everything I do.

[srslack]

It's also under the control of anything that it finds in its current "context window" that it decides to act upon, not just Microsoft...

https://greshake.github.io

https://kai-greshake.de/posts/in-escalating-order-of-stupidi...

[awegio]

> It sees what you're seeing.

In the video the user drag&drops a file into the copilot window. How do you know that it can see your screen? I believe "works with all apps" only refers to the third party plugins.

[eternalban]

> It works with all applications. It sees what you're seeing.

Does it also snitch on you to your boss? "Here is my assessment of the work habits of cs702 for this week."

[dano]

You: Clippy, Open the CMD window please. Clippy: I'm sorry, I'm afraid I can't do that. This integration is too important for me to allow you to jeopardize it.

[jfengel]

You ask the LLM to do what you want -- "summarize this email and send the summary to my boss."

Follow it up with "And send out my resume, because I can apparently be replaced by a computer."