I wouldn't say so. The 'Learning by mistakes' step in the demo shows that the AI can work through these issues, presumably this can be done more efficiently than a human.
The learning from mistakes part of the example is – you tried /port_wines but the path is /wines/port instead.
But what about if the path is actually /beer and you have to pass a hidden undocumented query parameter called ?wine=1 for it to give you wines. But then the response is still of Beer objects (because that's the only thing the API validator would allow), so you have to map all the Beer fields to their equivalent Wine counterparts. But not all of them make sense, so you have to ignore them. Which ones? Ask the engineering team. Turns out the guy who wrote all this left years ago, and no one remember how it works. Someone digs up a link to a documentation page, but that internal wiki was taken down and so it returns a 404. You ping a sysadmin to see if they kept any backups. He points you to a few PBs worth of SQL dumps from an internal migration a few years ago and asks you to take a look in those. You simultaneously have to write up a status update for senior leadership which is due by end of day and give them a revised launch date for the project. They want to know why it can't be done in half the time.
The day an AI can figure all this out, I will be looking for another career. Until then I'm fine.
But what about if the path is actually /beer and you have to pass a hidden undocumented query parameter called ?wine=1 for it to give you wines. But then the response is still of Beer objects (because that's the only thing the API validator would allow), so you have to map all the Beer fields to their equivalent Wine counterparts. But not all of them make sense, so you have to ignore them. Which ones? Ask the engineering team. Turns out the guy who wrote all this left years ago, and no one remember how it works. Someone digs up a link to a documentation page, but that internal wiki was taken down and so it returns a 404. You ping a sysadmin to see if they kept any backups. He points you to a few PBs worth of SQL dumps from an internal migration a few years ago and asks you to take a look in those. You simultaneously have to write up a status update for senior leadership which is due by end of day and give them a revised launch date for the project. They want to know why it can't be done in half the time.
The day an AI can figure all this out, I will be looking for another career. Until then I'm fine.