AFAIK nobody was collecting analytics. The one team I was working on had put out a goal of "30% more efficient" using AI tools. Its about as subject as you can get. We never got around to what exactly that meant before everything got shut down.
Myself and several other devs were laughing about the whole thing. The company was so amped about what AI could do they never even bothered collecting any analytics that would affirm or deny any of this had a positive impact. Even some of my team members were talking about the placebo effect AI has had on a lot of C-Suite folks.
This is all still going on at my company but they’ve been trying to create dashboards to measure us as good or bad with our output unsuccessfully but they keep shoving it through anyways. It’s demoralized a lot of people.
Probably meaning C-Suite thought productivity was up because of AI, either because A) metrics showed high AI usage or more commits/LOC or B) we're mandating AI usage, why wouldn't it increase?
For a lot of C-suite there has been more of a fast-follow approach to AI. CEO hears 3rd hand what competitors are doing, tells his CTO to "do AI" and "hire a head of AI".
So a lot of motion (do AI) was created without a destination (product outcome). The motion was what was being measured (we are doing AI).
Myself and several other devs were laughing about the whole thing. The company was so amped about what AI could do they never even bothered collecting any analytics that would affirm or deny any of this had a positive impact. Even some of my team members were talking about the placebo effect AI has had on a lot of C-Suite folks.