[Silhouette]

AI "support" bots that just attempt to read the published documentation for you are possibly the most annoying thing to have come out of the current AI plague.

Even Stripe - once legendary for the quality of its support - has apparently given up now. I had to deal with it recently over a case where the merchant was seeing an unexpected change in the way it was collecting payments and the AI bot was worse than useless - it actively suggested incorrect explanations and resulted in several days of trying to change the wrong things while the problem persisted.

For my own businesses we give this issue a heavy weight when choosing which services to use. We have even seriously considered moving existing integrations to different services over this one issue recently. If we're integrating with a service then we want to know there's a real person who can actually help if we have questions or anything goes wrong. Failing to provide that because it's cheaper to push everyone through the AI bot is a statement of intent about how much you value your customers.

[ryanschaefer]

The problem is using AI to “push” the answer to an asker. Unless the company has hidden docs they use for support (which why would that ever benefit them), I could get just as good of an answer if I point my LLM at your docs (“pull” an answer). In fact, the response might be better because I have context set up to tune it to my understanding.

Instead, you (company / support agent) have decided that I should instead have a conversation with an LLM through a worse, more opaque harness to the detriment of all of us.

[lokar]

It would be interesting to hear the other side, the people running support. I wonder what fraction of requests are answered by basic knowledge and stuff clearly in the docs. At some very high fraction I could see a lot of pressure/incentive to optimize for these cases.

[cthalupa]

From talking to people I know on support teams at hyperscalers and other tech companies: A mind-boggling huge portion.

But even as an AI believer and thinking it's great for this sort of thing, I also think if it's good enough for this sort of work, it should be good enough to identify when it's not capable of providing value, too.

[jamesfinlayson]

Gosh, that's kind of sad. I hate having to wait 12 to 24 hours for an answer from AWS support - there's no way I'm raising the ticket without exhausting all avenues from my end.

[newaccountman2]

> AI "support" bots that just attempt to read the published documentation for you are possibly the most annoying thing to have come out of the current AI plague.

I disagree, personally. The way they were employed in GP's example, yeah, that's annoying and hostile.

But almost every time I go to some documentation page for a commercial product now and it doesn't have that, I find it pretty annoying (I don't expect an open source library to wire this up and pay for it, ofc).

It means I have to convey these docs to my own LLM, I will waste cycles and tokens fetching them, etc.

[Silhouette]

Your version sounds like it's potentially useful. The thing that winds me up is when the online chat that used to be talking with real support people gets quietly replaced with some LLM-backed noise generator and there's no way to contact real support people any more (possibly because 95% of them were laid off).

[newaccountman2]

Yeah that's a totally different thing, agreed that's really hostile and companies over a certain amount of revenue should be forced to have human support agents.

[mschuster91]

> AI "support" bots that just attempt to read the published documentation for you are possibly the most annoying thing to have come out of the current AI plague.

Meh. It's no big change to before, where you had first-level support search for something vaguely related and just dumping a template to the user.

The thing is... it actually works better than I'd like, because in a lot of cases it turns out that you (as the user) forgot to follow one tiny step in the documentation.

What I'd actually like to see as the user is the AI actually going over my AWS account, looking up the resources and their state on its own, and figuring out what exactly I missed, but (un?)fortunately that cannot be easily done for IAM permission reasons...

[Silhouette]

The big difference IME is that first-tier support at decent companies at least had the grace to recognise when they couldn't help and needed to escalate. I can count the number of times I've seen an AI bot automatically escalate when it was unable to find the solution on zero hands.

[jamesfinlayson]

Agreed. I remember a couple of years ago raising an AWS support ticket and eventually got an answer about it being some undocumented limitation in Aurora Serverless v1. Now I get equivalent of googling my question before I can even raise a ticket.

[mhitza]

Even more annoying, is when the integrated "chat with AI" boxes don't actually have full knowledge about the website. Tried a couple of different such boxes, and in the end I still had to crawl the website on my own to find the information.