Hacker News new | ask | show | jobs
by dkrich 55 days ago
This article is the first that I’ve seen that hits on a theme I’ve been pondering for a long time. And that is that everyone super bullish on AI assumes that there are enormous real world gains to be had by existing companies automating software tasks- building software, using software- essentially moving bits around. I’ve been very skeptical of this.

We’ve had the ability to automate work between systems with bots and even regular jobs that automate certain repetitive tasks with APIs for years. Yet there’s been a relatively small uptake of bots and there is still a very large market for vendors an SIs who can improve existing processes.

I think it’s pretty clear why this disconnect exists between “regular people” and the people Patel describes as having software brain. And that is that the nature of LLMs is that they are limited to the digital world. At the core they really only do one thing and that is take some text, overlay it with digital representations of the world and try and find the one that most closely matches.

The inborn assumption is that they will get better and better and climb the corporate ladder, starting in the call center but climbing the corporate ladder to replace everyone’s jobs like Michael J Fox in the Secret of my Succcess. But I’m skeptical. Automation always starts in call central customer service use cases because that is one of the few use cases where humans are involved, they are supposed to follow a script, and take actions entirely inside software applications. But it always seems to stall out. Because once you move from jobs where a script can be provided to ones where ambiguity is a constant factor and judgments and decisions have to made that don’t have exact precedents you need humans. LLMs are backwards looking. Humans can consider things that have happened previously as guidance but critically, can also imagine a future state where things operate differently all why considering multiple competing factors, all of which are unique to that situation. They don’t always do it well but LLMs are incapable of doing it in any case.

People hate AI because it doesn’t really do that much for a regular person, is massively hyped by people who look shadier and less credible by the day and has some vague threat of destroying civilization or at least making you homeless.

But- I have zero doubt that if these same companies did actually excel at providing real world value, nobody would care about the negative implications. For example if they produced robots that could automate aspects of your life like cleaning your house, getting your groceries and doing it very inexpensively, I have no doubt the popularity would be off the charts and a bona fide bubble would ensue.

This is plainly true. First off, Waymo is one of the few companies successfully using AI to operate real world objects at enormous complexity and risk. Talk to anyone who just used Waymo for the first time and they will be almost euphoric. It’s amazing technology with overwhelming utility. There are also several examples of companies with less than stellar images who consumers were told they should boycott but most users couldn’t have cared less. Uber in its earlier days and Facebook coming out of the Cambridge Analytica scandal come to mind.