Hacker News new | ask | show | jobs
by zmmmmm 11 days ago
It's interesting how anemic the use cases seem to be - we see the same things recycled over and over: "reword my email", "remove object from picture", "add a reminder", "summarise my text message which was already only 20 words long" etc etc. As if these are the major problems in people's lives.

I really feel like there's a fascinating valley of death between simple things that actually work and things of real value that are actually still beyond the horizon. They either aren't reliable enough, aren't accessible to the tech, or exceed the sophistication of our existing trust models. For example, I'm planning a trip. Booking a multiday holiday - there's a real beast that is time consuming, complex and painful. I test out the AI tools. They fail. Hard. Hallucinations all over the place, false confidence, inability to act, inability of me to trust their actions.

It's just nowhere near practical utility yet. Not "nearly there" but "not nearly half way there". I got the top tier of Gemini AI. Can it rent me a car? "As an AI I can absolutely guide you through the process of renting the car, but I can't physically access the web site or type in the details for you".

27 comments

An alien landing on earth consuming Apple marketing content would be under the impression that humans did nothing but organise hikes to Big Sur with their friends.
That's insane dedication.
this shit is so normcore that i'm honestly embarrassed
And even if I organized a hike to Big Sur, Apple Maps would be pretty worthless because it doesn't have trail visualization and navigation worth speaking of (ok, maybe in Big Sur, but certainly not the rest of the world).

So I end up pulling out the trusty old Garmin gpsmap with cycle/hiking maps, that survived drops from 1.5 meters at 30 km/h as I was gliding of a mountain with my bike.

I recommend mapy.com (mobile app and web app too when on computer) - they mostly use OSM data and rendering of map tiles is great. Also offline maps etc.
There are several great options, besides mapy, e.g. Organic Maps and CoMaps also work pretty great. There are also some really good bike optimized apps (like NodeMapp for the Dutch cycle network).

But I generally prefer to use a Garmin GPS or watch. They work for days without charging (the older models even work with two AA batteries), very robust (e.g. their gpsr survives drops), work well offline, and transflective displays work better in direct sunlight.

For planned routes, I make then in NodeMapp or some other focused application and send the GPX overs to a gpsmap unit or Fenix watch. Many national parks, etc. also have great GPX files for recommended hiking/cycling routes.

Well.. it’s not the furthest thing from the truth in the bay
If I lived in California I'd be organizing hikes to Big Sur with my friends. Alas, I live in a damn cornfield. Maybe it's meant to be aspirational?
I remember a couple of years ago it was all about booking a table at a restaurant, as if this would be the main spare time activity of people in the Apple bubble. I wonder when the shift from restaurant bookings to outdoor activities happened. Maybe a pre- vs post-Covid thing?
Yuppie skateboarding videography was also a classic.
That and going to Philz or Tartine afterwards. At one point both those places were on every Apple marketing copy.
As Psychology is the study of the psyche of white male psychology students, big tech is technology for affluent citizens of San Francisco with a career in IT…
> Psychology is the study of the psyche of white male psychology students

Huh? Maybe my uni was an outlier / it is a UK thing, but there were ~99 female and 1 male psych students in my year. This was not considered unusual.

It's actually "WEIRD", Western, Educated, Industrialized, Rich, and Democratic. The "white cis male" meme says more about GP than psychology.
This may support the point further xD
And we all wear polo shirts
best comment I've seen on this site in a while
That would be deceptively constructive and healthy compared to doom-scrolling instagram or tictoc while clogging the intertubes with AI slop.
Even the aspirational use cases you're talking about basically are just "digital secretary." There's a massive problem with that even if the models end up being capable in the future. The value of a secretary is that you know them, they know you, and you trust them to do things right. There are stakes if they don't. No company can provide that as a service at scale for everyone without it being a disaster. Not because it's not technically possible, but because of the incentives. That much power over the details of so many people's lives is irresistible; there will be persistent temptation to use it. The presence of that possibility makes the secretary impossible to trust.
The vast majority of people never even asked for a personal assistant, because that isn’t something normal people have or do need in the first place. They aren’t so occupied/privileged/posh to need someone to do the trivial tasks of daily life for them.

This whole venue of technology is an exercise in ivory tower construction completely disconnected from ordinary people.

I think you are wrong.

They never asked for one becase they never imagined being able to afford one.

The amount of administration organizing a normal household takes I suspect most would be glad to leave to someon/something they trust and that can be held accountable.

Today that someone needs to be a person (imo). But who knows, a startup may be plotting accountable digital assistans as we speak.

I would want someone who could physically work in my house, performing the chores/daily tasks I don't want to.

I have zero use for AI. What's it going to do? Read the 3 emails about bills I get?

Certainly someone out there has a use for this functionality, but when you say "household admin tasks" the last thing I think about are /digital/ admin tasks.

I think theres some real use cases in the household department. I would love an AI that I just tell my nutrition goals (I want to eat X calories, Y protein, Z fiber, hit all vitamins) and it just generates a full meal plan for me each day. Like, I go to the store and it made the complete shopping list for me. And automatically updates the rest of the day if I tell it I skipped a meal or ate a snack.
I get where you're coming from but at least for me you appear to be looking to automate away the interesting bits while being left with the tedious ones. What I want is the opposite to what you're asking for - let me dump a rough meal plan into whatever thing is doing this giving an overview of what meals I want to cook this week and then have it go place an order with the supermarket for delivery of the necessary ingredients taking into account what I've got in the house already.
Eating disorder as a service does indeed sound like a business plan.
Some people would use the GP's idea that way, yes.

But that's absolutely not what he's describing. He wants not to think about it, that's exactly the opposite of a disorder.

Anyway, an LLM assistant is also exactly the worst technology to use there, on every dimension.

Why would having goals on fiber, protein, and vitamin intake be an eating disorder?
Pretty sure unaccountability is a desired feature of management decisions in most organisations.

That quote has an unexpressed precondition to the effect of "In order for an organisation to be objectively well run..." or "In order for an organisation to equitably benefit all stakeholders at all levels..." etc

Giving normal people something that has only been available to rich people is a staple of technological innovation. The problem in this case with Siri isn’t that people don’t want an assistant. It’s that it doesn’t actually work yet.
But normal people have entirely different problems than rich people do! The amount of administrative overhead that would warrant a personal assistant is just vastly lower - most normal people:

  - don't travel frequently, 
  - don't have so many complex inquiries that require someone to research,
  - don't have super complicated taxes to file, 
  - don't go eating out in fancy restaurants that require special skills to get reservations in, 
  - don't have so many meetings to attend, 
  - don't receive hundreds of emails per day,
  - don't work on multiple projects at the same time,
  - don't organise festivities and social gatherings all the time. 
Yeah, there probably are some things that could be simplified by delegating to someone, but they don't justify a human PA at all; and out of the remaining tasks, most are not really digital in nature: Going for groceries, doing chores, child and elderly care, interacting with other people, and so on. Digital assistants can't help you with any of these.

The one thing that would be useful - a kind of "chief of staff" that monitors your entire digital life and prioritises your every next step - is the antithesis to Siri and the like, which are merely reactive to your requests, not proactive in figuring out what needs your attention next. Let alone that that would be a total privacy nightmare, and a prime candidate for mass manipulation at scale.

Bang on.

Like you said, the non-digital things are where people need assistance most. Fold my laundry, clean my house, clean my car, make me dinner. At an affordable cost. I don't need you to book my trip to an all inclusive resort that I go on once a year at most.

We're at this place where AI/LLMs is truly incredible technology, but the futuristic vision of robot assistants doing things for you at an attainable cost isn't there yet - so a lot of companies/startups are trying to force feed purely digital consumer AI products (assistants/agents) that no one wants.

In the US, every time I file my taxes, I wonder what % of people don't meet the cognitive barrier to successfully file. I suspect a large portion of people offload tax filing to a service or accountant for numerous reasons, which is basically a personal assistant.
Personally, I'd more interested in Reminders actually being able to sync lists properly and not delayed or reshuffling items while I'm typing before they would work on a personal assistant. Reminders (like Siri) has become the favorite joke of the family by now.

They don't even seem to get the basics right, why would I want another layer on top?

That's why I like reading HN. These people are smart enough to destroy the world but too stupid to realise they're doing it
it's an interesting question if any of the AI companies would be willing to step up and absorb the risk ie: to give the AI agent a "stake".

eg: if my booking is wrong, they will cover the cost and compensate me. It would sort of just come down to buying premium travel insurance for everyone that uses it. And insurance for anything else they do. It has to be one of two things - they either believe the risks are worth it (so then there should be a financial model that can absorb the cost of insurance to do it), or in fact, the risks are too great. At some point, if they keep offering the tech on a "use at your own risk" basis, they are implicitly communicating that they themselves think the risks are too great - so YOU shouldn't trust it either.

> eg: if my booking is wrong, they will cover the cost and compensate me

That would be nice, but it's the wrong angle. The reason people like real secretaries is not because somebody is compensated when things go wrong. It's because things don't go wrong. I don't use this thing if I need to fear things go wrong, even if I'd be compensated.

Maybe it would provide the right incentives for the companies though.

Surely, if the compensation was high enough, you'd be like, "Sure, I'm happy with that outcome." And then, if the AI company thinks they have a low enough failure rate that the expected cost of paying out the compensation still lets them make a profit, then they could make that promise to all customers.

Though a compensation that high sounds like it would invite fraud, where the customer would be glad to have something go "wrong" and get a fat check. Not sure if that's a solvable problem.

they are literally burning billions of dollars and can presumably keep doing this for a while. Taking a trivial amount of additional financial liability to launder their reputation wouldn't meaningfully improve things.
These use cases will just be built as "open source" (openclawd) or even custom one off application in the future. I've been building apps to run the tedious parts of my life recently. Meal planning, personal finance, bills, tax organization... Why would I pay for services that will be enshiftified when I can build a app that does exactly what I want in an afternoon. Yes the code is shit and it wouldn't scale... But it doesn't need to
> Why would I pay for services that will be enshiftified when I can build a app that does exactly what I want in an afternoon

Because the problem now took a whole afternoon to solved and sapped your creative energy instead.

> Why would I pay for services that will be enshiftified when I can build an app that does exactly what I want in an afternoon.

When we talk about “the market”, the customer base, remember it’s a market that typically doesn’t know how to or care to even install an adblocker.

I don't see any mention of "the market" anywhere in this thread. I'm just talking about the ability for a motivated user to solve real problems with these tools. Right now these solutions are available to software developers but over time it will become approachable to more users
For fun I planned a holiday entirely with LLM's lately, and followed through.

It used good models and did a lot of searching, including searches in other languages. It got nothing right, riddled with fake places and times. It also found some weird and unique places I never would have considered.

I had a blast, brought me back to traveling pre-internet, requiring a level of spontaneity I had forgotten we used to depend on. 100% recommend it.

The juxtaposition between what perhaps the best single use case I have seen for AI and how bad of an ad for it is killing me. I love it.

"I told my bumbling assistant to plan a trip for me and he got nothing right but I enjoyed it because the chaos introduced a certain spontaneity and whimsy missing from my life"

I found that Deep Research mode in Gemini was able to give me a well planned 4 day trip to a major city.

I told it my preferences and of the group members, where we arrived and departed, at what times. I gave it my itinerary and then asked it to plan two new itineraries and also suggest a location to book a hotel that was convenient for the early flight on the last day.

I went away for 20 mins and gave me a 20 page document with a good summary and decent options. I did choose some of the activities it suggested.

I did this 10 months ago. It’s probably better now.

But Gemini has access to google maps, so it can estimate travel times, and know which lunch places are near which sites and which hotels have good reviews. So if you want AI to work for travel panning you need to ground it in good data.

Or maybe there are just a few complete trips to major city in the training data that it could copy from? I imagine major destinations are much easier.
I used LLMs last year to plan an multiple week itinerary through Japan with the family, I wasn't super happy with the result so I tweaked it but they provided a useful template and some surprising ideas.

As you guessed, there's a ton of info in the training data on this topic, but there's some value in being able to see it on one place with different options.

I think your experience with that trip echoes mine in a lot of areas. It’s a decent start. It takes care of some of the initial blue sky thinking to lay the groundwork. The problem is I think that’s the funnest part of a problem and I hate working on the details… it takes most of the creativity out of most problems as if it was drudgery, while leaving me to do the nitty gritty, which I consider the actual drudgery. I just don’t see LLMs’ contribution to tasks like this being anywhere close to being worth what they’ll cost after the VC subsidies run dry.
I think that's a large part behind the "success" of LLMs... people vastly overestimate their uniqueness.
It’s really one of the most flabbergasting things about discussing LLMs with the naysayers.

There are a lot of extremely legitimate concerns, like the environmental impact and so on.

But I just laugh when they point out that LLMs are merely clever regurgitators of their previous inputs… as if this isn’t how we as humans operate nearly all of the time. People realllllllllly want to think they’re special snowflakes.

It is not in fact how humans work at all.

Ask a human to plan a trip:

They do research, Pick destinations led by their own experience/likes/dislikes Compare to other guides Plan itineraries so they can get there Check and share

Ask an LLM to plan a trip:

It takes the prompt and continues it based on weights in the training data. If there is no data it picks the most likely thing (maybe made up). If there is it’ll mostly add things from that data. Maybe it’ll make tool calls and pull in data that way too but you can’t actually trust all the details.

These two processes are so different, it’s important to understand how they work, which is nothing like a human.

To counter, we did the same with a trip to Copenhagen for 7 days and it got most paths correct. Train routes, places to visit with kids, restaurants, reservations, weather, most of it was great. There were a couple mistakes of course here and there, thankfully we did our due diligence, but by and large, we plan to do this for future trips.
I feel like one city is enough focus to actually get good results. If you plan a trip where you move between different (smaller) places problems start to arise
I've been planning vacations with ChatGPT's Deep Research since it became available. Absolutely brilliant!

From finding areas with favorite activities for each parents, teens and kids to discovering the do-not-miss attractions and scheduling our vacation between them - it is invaluable. I've seen places I never knew existed in countries I've never been to before and speaking languages I did not speak.

Very few mistakes and lots more flexibility and understanding than the travel agents I used before. I do write long prompts though with lots and lots of info about our family and what we like to do.

Not yet good at finding, filtering by our criteria, comparing and booking available accommodation yet, but it's getting there.

Its not pre-internet travel, rather backpacking. I do it to this very day, by far the best and most rewarding way to travel, the further and more exotic the better.

It has a downside - I'll never do these pre-arranged trips where one is in complete luxury bubble, interactions with locals are the best part of experiences. What a waste of potential.

And yes its mostly compatible with kids, it depends more on specific location than mode of travel (ie avoiding malaria/dengue/etc. regions)

That was funny, thank you.

I am now reminded of a short trip with less tech savy folks, where I also on the trip noticed that the plan was a bit .. not working. And the person organizing it complaining to the bus driver, why they were not going what the internet told him, they were going. The internet being ChatGPT.

What was a “good model” and harness? I would expect decent results using say Codex with 5.5 xhigh to research and verify an itinerary. 5.5 Pro with search would also be promising.
I suspect it would perform admirably well with 'Paris' or 'Copenhagen' (see sibling comment), but if you want to have some real fun try 'Southern Spain' or 'Rural Malaysia'.
OPPO just added a great feature into my phone. You point your camera at a foreign restaurant menu and it generates a translated version including a picture so you can get a general idea of what it usually looks like.

The genius part is that the menu is interactive, so you can add items to a shopping cart, which then results in a local language text you can show to waiters asking them for your full order.

It was a great sample of how even a little bit of ux can go a long way.

Spot on!

I am also under the impression that the LLM tech is plateauing before bringing the promised productivity. Great as a coding assistant, great a summarizing a text, translating, great a helping plan a trip...

But for the rest, e.g. act as a life assistant, it is still far off with no hope to reach the desired performance level.

I would not be surprisd to see OpenAI and the likes to start reverting to Siri v1 strategies, i.e. "if this then that" kind of agent routing.

Why this is surprising? LLM-s are good in text generation on the base of the stuff they were trained on. Software is text generation, translation is text generation, LLMs can answer questions since billions were spent on tuning foundation models, that is people were collecting in (semi)automatic way questions with answers to the point we might think that LLM-s are "thinking".

Now people want to handle car rental. What are the relevant data that models were trained on for this kind of application? For Python code there is kirjillion examples on Github, for mathematical proofs there is endless stream of papers, books, etc. But for car rental? Mostly adds in the internet that want to trick you into a bad deal. So yes, LLM will be a disappointment, as it tries, well, to trick you into a bad deal. In addition, data are rather scarce so there will be a lot of hallucination, as it gets mixed up with yacht rental, bikes rental, ski equipment rental, etc.

Who said it was surprising?

The performance of specific tasks will depend on either those tasks having been included in the training (which Apple could work on), or added by ways of fine tuning, and context sourced from userland.

For any category of tasks, there's a ton to be gained still in terms of how context is populated more effectively (relevance) and efficiently (token use). See software engineering harnesses and the skills architecture of OpenClaw for example. SWE harnesses make all the difference in how well Claude Code and OpenAI Codex perform. OpenClaw can't do shit without loading skills from the filesystem into context JIT.

I'll be very curious to find out how Apple is feeding context in their new AI approach. Part of it appears to be an 'index' that my iPhone started building (visible in main Settings screen) after installing the iOS 27 Developer Beta.

Yup, precisely. Turns out getting AI to be reliable at doing useful things is harder than we've all been led to believe by the dominant narratives.

https://www.normaltech.ai/p/new-paper-towards-a-science-of-a...

My high school kid has a printed basketball schedule for this summer. I tried taking a pic with Siri to parse it and add it to the calendar with their visual intelligence thing or whatever. It can't do it. I had Claude parse the calendar picture and generate an ics file. Calendar on iPhone and on their website can no longer import ics files. This is like remedial AI functionality that probably could have worked 20 years ago, and it can't do the simplest most basic task.
Lots of tech used to work and was just deprecated because it's not profitable. Google used to have amazing features on android, assistant and maps, that are just gone now, and slowly coming back in gemini.
It reminds me of the Apple Vision Pro hype trailer. "Put on a helmet so you can view 2D photographs in 3D space." Present-day Apple sure has a way of making extremely impressive tech seem totally superfluous.
Renting a car isn't a problem I have either. I've rented cars and vans plenty of times. I just phone up and talk to someone or email them. It's really easy.

A lot of these "problems" seem to stem from people just not wanting to interact with other people at all. Do we really want to become like Asimov's "Solarians"?

Millennials and below absolutely do want to avoid interactions with strangers. Especially gen Z will go to great lengths to avoid making a phone call.

It sucks. This is why none of my local supermarkets have real checkouts anymore.

I don’t think generational stereotypes are at fault here. This is another lazy retread about how Millennials/GenZ killed -insert thing here- straight from businessinsider.com

Nobody wants to make a phone call anymore because most calls are scams; phone networks are terrible and apps have replaced them, like a lot of legacy tech.

Supermarkets make more profit if they pass on the checkout labor to the customer. That’s the whole story.

These generations are disillusioned from decades of decline in our society that have root causes predating any of them.

> Nobody wants to make a phone call anymore because most calls are scams; phone networks are terrible and apps have replaced them, like a lot of legacy tech.

This has nothing to do with the unwillingness of young people to use a phone to call a business.

> Supermarkets make more profit if they pass on the checkout labor to the customer. That’s the whole story.

It's half the story. The willingness of young people to accept it, and even prefer it, is the other half.

Agree and disagree on the "planning a trip" use case... as I'm sitting on a river cruise on an AI co-planned vacation (we found the cruise, AI set the daily itinerary).

Now the big (BIG) caveat is that I used Claude Code on my Max 20x plan from within VS Code. I have a fairly decent harness that I'd built and was sure to prompt it to run several subagents, including one that grounded walking times with Google Maps directly.

I'd say this is FAR beyond what the average person would do ("Hey Siri, plan me a trip to Prague") but also it shows that the models can do it with the right harness and guidelines. This wasn't that hard for me to do, so it seems to be more of a feature buildout ("the travel expert" AI) with a few markdown files than anything.

All told: web search for grounding times/locations, map grounding for walking paths and times, an adversarial agent to keep the model(s) honest, and a little bit of prompting and you've got a really great travel planner.

In short: the average person won't do this, but if I can build it in a few hours any of the 100% of people working at Apple/OpenAI/Anthropic who are smarter than me can build it and bake it into Siri (or ChatGPT, Claude, etc).

Extremely surprised we didn’t get the “book me a flight” example that has been an AI demo used over and over but everyone’s so particular about flights I can’t see many people just wanting to one shot it.

The laundry list of object removal, spacial photos, better speech to text etc is always just the latest open models just being slapped in there and branded as Apple.

Ultimately the meat of this presentation was the work of people outside Apple.

For me "book me a flight to X on day Y" is so easy to do manually I don't need AI.

Where I do want AI is for really complex queries, like "find me a time and money efficient itinerary through Europe visiting places I haven't been before. Present options and I'll tell you what I don't like about each of them then we'll narrow in on an optimal solution"

The issue is anything that is of value requires some level of detail, of complexity, and that is only of interest to people that know that specific complexity, and it is a pain point for them. Now they'll care. Everyone else? Lost them. So, the marketing challenge is to find some aspirational complexity that people wish they knew, and how that can be solved with AI, and without turning that thing into a trivial nuisance, but a valued skill. That logical series right there is, well, too much for far too many.
We are currently working on this with Audiala (iOS and webapp, Android should be released any coming days), making progress slowly but surely. We started to add tools to the AI chat to organise your trip and explore the place following your preferences and those of your group if you decide to share the trip. We can turn feedback into actual improvements pretty fast now, so would love to have yours and progress towards building the app you really want.
All you're saying is that (the harness you're using for) Gemini sucks. OpenAI has their own web browser to fill out forms with and Claude has a whole Cowork feature that interacts with you computer including your web browser.

If new Siri still sucks, well, it's sucked the entire time. The worst of it is the security aspect where the setting to let you use Siri without authenticating hasn't worked since they added it! (still broken, iOS 26.5)

I get the impression Apple designers don't actually use AI, and so have no idea what to build, since users don't know what they want from AI yet either.
> As an AI I can absolutely guide you through the process of renting the car, but I can't physically access the web site or type in the details for you

It’s like they were trained on corpuses of box ticking material, like iso 9000 documentation, or security certifications. And now they know how to describe what they should be doing, but they never actually do anything.

I sometimes do random weeklong roadtrips. ChatGPT is the best way to do this. Attractions that are esoteric, RV parks with 50A hookups for under $50, oldest/biggest/best restaurant with local food in a town, historical stops along the way, suburbs close to big cities but where hotel prices are lower etc.
i have not tried it since i’m too scared to try, but i know Codex recently came out with a feature where it can control your chrome browser. Not spin up a chrome browser, but control your open browser tabs.

Presumably you might be able to task it with planning an itinerary with specific dates and bookings in mind, and then ask it to complete the task…sort of. The big gotcha i think is payments. Obviously you wouldn’t want to enter your credit card details into an llm lol. perhaps it would be ok if you had a saved card on file with your favorite airline, etc? Or maybe chrome has a feature to autofill a credit card for quick entry? Not sure.

Still…it’s a messy unsolved problem and we’re definitely not there. I wonder how this tech will look in 10 years from now?

> interesting how anemic the use cases seem to be

Have a conversation with the average Ai power user (outside of tech / coding) and this is the level the conversation will be on.

Skill issue. I've had gpt5.5 help me plan a vacation. It even pointed out where I could save money. I did the actually bookings but it created the plan.
This morning, while putting in daily contacts, I realized I was down to my last few pairs. Still standing at the bathroom sink, I used the ChatGPT app on my phone to voice-command the Codex app on my computer to book an optometrist appointment for Saturday. It visited the website, figured out the API, and booked it.

No, this isn’t the same as planning a multi-day vacation. But it is plainly useful today, and it feels very close to handling more complex tasks like that.

Maybe the difference is the model and the harness. At this point, I’m starting to think some people are either gaslighting themselves about how useful these systems are, or overgeneralizing from one narrow setup. Gemini, for example, seems especially weak at agentic behavior.

The wholesale dismissal just feels strange coming from the HN community I’m used to.

This is the kind of example that people use to demonstrate "usefulness" that falls so flat to me. I could make that phone call in a minute and have no doubts about whether my agent had stuffed up somehow.

It's just not compelling to say that an AI can do an easy task quickly. This is still worth zero dollars to me.

It is neat, but come on you could've booked from website on the phone too.
there is this bullshit term you hear paraded about the dwarkesh-adjacent circles: "capability overhang". Aside from being effectively meaningless jargon, there is a kernel of an idea that somehow the models are far more capable than what "normies" use them for.

Well, I think Siri AI puts this notion firmly to rest. Yes, if you have unlimited tokens and well-posed problems you can solve open Erdos problems. However, if you have meaningful real-world computational and reliability constraints then you better just stick to "summarize my messages and find the dogs in my photos".

And this isn't just Gemini, I can burn effectively unlimited Opus tokens and still get garbage code out or be run around in circles without very diligent oversight.

Its feels as if apple are trying to create deterministic use cases for AI - a non deterministic solution!
Booking and renting is certainly possible, they just need your auth credentials
I gave some LLM's my password manager and some credit cards to try to do this sort of thing lately.

They failed most of the time. Simple things like finding the right password for Gmail sometimes was out of reach. Anti bot techniques sometimes stopped it.

Impressively, sometimes they'd successfully write hugely complex bash or python scripts to do tasks on web pages they hadn't managed to do with the browser automation.

Yes, big companies do not know how to advertise AI. AI isn't a killer feature for anyone except people working in AI. No one uses it for anything but party tricks otherwise. The things AI would actually be useful for, it is incapable of doing.

AI as a "product" is about sucking up data for corporate interests first, then providing functionality to common people last with probably a few other steps in between.

Marketing departments have to twist themselves into pretzels and invent customers that don't exist in hopes to sell AI to people who look at those fake customers in the ads and go "Gee, I wish that was me!". People who casually book trips to Japan to shop for vintage clothes generally don't exist in such large numbers that they justify entire product stacks.

Here's what I need AI to do. Open an app, perform an action in said app, close app. Maybe open multiple apps and do things in other apps that are contingent upon data from one of the other apps.

Here's what AI can do. Poop Emojii with glasses....

My iPhone knows the forecast for today.

I installed iOS 27 yesterday.

I asked it: please notify me when the temperature goes above 80F (so I can close the windows).

Siri responded: it'll be 99F today in Phoenix.

...

do you live in Phoenix?

I just asked Siri a few weather questions and named the city where I live, nailed it. My favorite digital device is my Apple Watch and if Siri improves over the next hear or two, that will be great for me.

I live in Phoenix. I would like it to tell me: 8am. Not what the actual high is today.
I am on a wait list for the ‘better Siri model’ - what iOS and macOS betas just shipped with is awful. I do think the Apple Foundation Model built in to the system is better: I was using it from Python yesterday and it performs tool calling accurately and it is a very small model.
"I got the top tier of Gemini AI." - that's your issue, get a subscription to a lab offering actual frontier models like Anthropic and OpenAI.
Model != AI tool. Especially with Gemini, the model is fantastic, both in benchmarks and in the API. Sentiment is not that positive for Google AI.