Over the weekend during the International Dota 2 championships one of the world’s top players, Danil ‘Dendi’ Ishutin head up to the main stage to take on a highly trained OpenAI bot. They squared off in a 1-vs-1, with the OpenAI bot coming out on top twice in a best of three. Bow down to our robot overlords.
OpenAI also tested the bot against SumaiL, the top 1v1 player in the world, and Arteezy, the overall best Dota 2 player in the world. In each instance, the OpenAI bot always came out on top, remaining undefeated.
1v1 Dota 2 is unsurprisingly a very different beast to 5v5, relying on much trickery and planning to deceive opponents and come out on top. According to OpenAI, in 1v1 there is little correlation between player skill and actions-per-minute, so this mode is weighted more towards tactical choices than your average Dota 2 match. The OpenAI bot reflects with, with actions-per-minute comparable to an “average human player.”
OpenAI claims its bots are able to learn from opponents and adapt accordingly. It achieves entirely through self-play, churning through match after match in order to help predict where other players are likely to move in particular situations, how to adapt to odd scenarios, and how to influence the opposing player’s allied units.
Dota 2 really is the new chess isn’t it, this time played at a breakneck pace that seems to be handing the machines the advantage over us mere mortals. The next phase of the OpenAI project is to create a team of Dota 2 bots for 5v5 action. While the core remains the same, these new bots are going to have to learn the concept of teamwork to come out on top.