[Ukv]

Given the quote is referring to what they've done "for years and years and years [...] in our product groups" outside of the OpenAI arrangement, the fact that a large number their of products have come to make some use of AI models without much fanfare (search, spell-check, spam filtering, voice dictation, language translation, recommendation systems, ...) is not inherently due to the more recent LLM shoehorning. Machine learning is just the best choice for a good number of tasks.

[peteradio]

I'm not talking about LLMs in particular. I guess this is a company wide mandate to grow knowledge of how to do this stuff well, I mean that makes sense. But in the trenches (aka hells-ahole) that means a lot of bad bad stuff is being relied on and it generates calcification of business segments and kafkaesque anti-patterns for the uninitiated. This doesn't only apply to "AI" its a generic feature of shoe-hornings. The problem with the shoe-horn is that its politically costly to resist even if it makes good business sense to resist at the micro level.

[Ukv]

I'd agree that "We're going to shove a chatbot in every single one of our products", like the recent Copilot integrations, would reek of shoe-horning and a possible company wide mandate.

But remarks more along the lines of "Looking back over the past decade, we've made use of ML models in some part of almost all of our products" seems fairly reasonable to me, not necessarily indicative of much other than machine learning being the best tool for an increasing number of tasks. If they weren't using ML-based echo cancellation in Teams calls for instance, they would have a worse product than competitors that do.

[peteradio]

Teams doesn't even do copy paste or open Microsoft based formats in under 10 seconds (IME)... I rest my case.

[Ukv]

I don't claim that Microsoft products are perfect, just that it seems a reasonable use of machine learning. The things I've seen them use ML models for are genuinely useful, and mostly added without too much fanfare years prior to the recent generative AI hype.

[peteradio]

I'm saying that forcing particular technology leads to worse products in many cases.

[Ukv]

I understand, but think that in many relevant cases it'd now be non-ML approaches that would be "forced". Machine learning is just the easiest and best way to accomplish a large range of tasks.