Hacker News new | ask | show | jobs
by a_humean 2851 days ago
So three major differences between this and the last big match for OpenAI Five which explain the different result in favour of the Humans:

1) The Humans, Pain Gaming, is a professional team with players that regularly play and practice together and attend major tournaments. While they are the weakest team at this event and are arguably there only because of a regional qualifier system (they are from South America and the strongest team in an up and coming region), they are capable of taking games off some of the strongest teams due to their unpredictable and dynamic play. They are substantially better than the team of ex-pros and commentators that last played against the AI.

2) They removed an important limitation in the game, which was the 5 invincible couriers, and replaced it with a single killable courier that the five agents have to share (just like in a normal game of dota). The AI was able to use the single courier effectively, but did occasionally let it die a bit too often. What is important about this change is that it invalidated a strategy of the AI which was to continuously ferry consumable healing items to enable relentless aggression after gaining a slight edge in the early game. The AI adapted to this change by playing more cautiously in light of this standard resource/logistics constraint. It adds strength to the argument that as the OpenAI team introduces more complexity and resource constraints back into the game that the AI's weaknesses start to become more apparent and exploitable by better players.

3) The heroes composition was drafted in advance to be as even a match as possible, and a coin flip was made to decide which team got which draft. This is important as the version of the game is a subset of the game, and the humans evidently didn't understand the meta game in this weird subset during the last event. From the AI's perspective this was as even a draft as possible given the very small hero pool. In the last event the AI predicted 70-95% win confidence before the game even started due humans not understanding the drafting meta with a pool of 18/115 heroes and no bans.

Still, really impressive performance by OpenAI as at least for the early game and some of the mid game it was a close game with lots of good plays by both sides. The fact that OpenAI can be comparable to a pro team in what is nearly a full game of dota is really impressive.

1 comments

> 1) The Humans, Pain Gaming, [...] are the weakest team at this event and are arguably there only because of a regional qualifier system...

I think it's totally disingenuous to call them the weakest team at the event. Two other teams performed worse in the group stage and one tied Pain's score, but still made it into the main event through sheer luck. Pain has won games against every single one of the strongest teams there.

If you follow pro Dota, you know a lot of these games hinge on how a team happens to be performing on a certain day. Just this past May, Pain played in one of the top Dota tournaments of the year with 9 other teams who also happen to be at The International with them now -- and Pain came in 3rd place, ahead of Fnatic, OG, and Mineski.

And you just selectively quoted me to remove all of the qualifications and praise that I used to make it appear that I'm unduly harsh.

In that paragraph where you selectively quoted you removed the clause where I said: "...they are capable of taking games off some of the strongest teams due to their unpredictable and dynamic play", which is is no different to the point you are trying to make.

Fact is, they came last, they were lucky to attend given it was a surprise that their region was given a slot for the first time ever, but proved themselves to be a capable team from a region that is starting to get international exposure, and you are deliberately misrepresenting me.