[nextlevelwizard]

It is useful since it means copilot is not taking your job any time soon. i.e. if 40% of the time the human driving the thing is needed to intervene and prevent obvious security flaws then expert is still needed to use the tool.

[0-_-0]

I think it was obvious from the beginning that it's trained on GitHub code, so it would be surprising if it was better than the average code on GitHub.

In any case, if Copilot can generate code as well as the average programmer without supervision, that means it can already take the job of 50% of programmers. A more useful metric though is how many programmers can a person using Copilot replace by having greater productivity?

Also, in how many programming jobs does security matter? In my job for example it doesn't matter at all.

[nextlevelwizard]

With any commercial software security matters. You don't want your licensing solution to be craked by editing a file.

Anything that connects to any server or has any sort of networking.

Anything that needs privileges (like installing drivers) needs security.

Anything that reads/interpeds any data given to it needs to have security.

Of course this all depends what you mean by "matter". I can't come up with a program that doesn't need to think about security at all expect something trivial like hello world.