As someone who plays dota, this bot really isn't that impressive. The hero they chose is seen as a very difficult one to master for humans, precisely because judging distances, current life, current mana, damage etc. is so difficult to do on the fly and even if you can keep track of all of that in your head, you need extremely precise inputs to outplay your opponent. Yet by going through the API, they handed all of that to their bot on a silver platter. They pretty much let the bot sidestep the core challenge of this hero, while it was kept in place for the human players.
On top of that they also reduced the complexity of the game quite significantly by limiting items etc., which further reduced what humans could do against the bot. Even then, the bot utterly failed once humans were allowed to use a tiny bit of creativity.
And that's not even taking into account that this was not even close to the complexity of a real dota match. The big challenge in dota is in the decision making with incomplete information and in coordinating 5 people with only voice and the ability to ping the mini map, in a giant "search space" created by hundreds of different heroes, items and game mechanic interactions.
Several years ago, League of Legends released an upgraded suite of bot characters. One of them, Cassiopeia, had to be turned down enormously from her best play to make her viable. She could beat many of the game's devs (mid-tier hobbyists) and was a non-zero threat to professional players. This was, to my knowledge, achieved with little or no machine learning at all.
The defining traits were similar to what we see here. She had area of effect spells with casting delays, meaning that the ability to precisely evaluate how other players could move was crucial. And she had a spell which refreshed based on the effect of those AOEs, meaning that millisecond precision was a major source of her ability to deal damage. And her ultimate was an exceedingly touchy and unpredictable disable based on the angle opponents were facing (in a game with instantaneous turning). Even top-tier pro players regularly lost its effect because of latency or judgement issues.
The results, by all accounts, were terrifying. She was barely competent strategically, but as long as she could afford items (and admittedly, the LoL bots don't need to farm) she could win all of her tactical fights simply by inhuman precision.
The OpenAI project is more admirable than that. It uses real farm, makes item purchasing decisions, and apparently has a rate-limited API. (That last seems especially important.) But I still wonder how much of the bot capabilities are derived simply from inhuman accuracy.
In terms of Dota, I don't think it's that impressive, but it is still cool. I'll be impressed when I see a 5v5 with bots that adapt to the opponents' strategy. I do think that it currently could be an excellent tool for mid-laners and cores to practice. OpenAI is also blowing the door open to Dota AI development and we will soon see bot tournaments. Engineers will develop AI and put them against one another in standard 5v5 matches with a pick/ban phase and all.
In terms of AI, I don't /think/ there's anything groundbreaking here. Correct me if I'm wrong, as I don't follow AI research, but this technology is nothing we haven't already seen. I believe the development of AI for Dota is a publicity move to get people excited about what AI could be for humanity. This might be the way to introduce AI to non-technologists and get people excited about it.
> This might be the way to introduce AI to non-technologists and get people excited about it.
Yeah, I'm almost positive that this exhibition is intended mostly to raise awareness and create this hype. Go and Chess, for most people, are simple games compared to Dota2, so if Elon is worried about AI and want people to be more aware of the threat he perceives it certainly helps to make this big show and get all those impressions with a game that is considered by the majority of people (especially younger) to be more complex/harder than what has been done before.
The bot would be more impressive if it used vision or buffer to analyze everything. The bot has all of the information which a human does not have. If the human had the same information I think it would be a better competition.
To me it seems that this bot is good only by the fact that is has information and input advantage.
I also want to clarify that this is not an unflavourful feat and that I think it is cool. But I noticed that a lot of members in the Dota community did not know of the bot API which is likely the case here.
On top of that they also reduced the complexity of the game quite significantly by limiting items etc., which further reduced what humans could do against the bot. Even then, the bot utterly failed once humans were allowed to use a tiny bit of creativity.
And that's not even taking into account that this was not even close to the complexity of a real dota match. The big challenge in dota is in the decision making with incomplete information and in coordinating 5 people with only voice and the ability to ping the mini map, in a giant "search space" created by hundreds of different heroes, items and game mechanic interactions.