Dota 2

“So I leave, there is nothing, I come back, there is this reinforcement learning bot, and actually, it's beating our scripted bot after, like a week worth of engineering effort. Possibly it was two weeks, but it was something very miniature compared to the deve…”

“There was a point after the event where we set up this big LAN party where we had, like, 50 computers running the bot. We kind of unleashed this swarm of humans to kind of add our bot. And they find, found all the exploits”

“We first played our TZ who showed up on, on our switch bot, you know, kind of the Franken bot. And you know, that beat him three times.”

“It was like one of the major examples, one of the major examples of the things that we kind of didn't have explicit incentive for, and yet the bot actually learned them.”

“Originally, we were downloading all of them every day, and realized that was about two terabytes worth of data a day. That adds up quite quickly, so we ended up filtering down to the sort of most expert players.”

“Actually the way that we selected the game was we went on, on Twitch and just looked down the list of most popular games in the world and starting, you know, number one is League of Legends. The thing about League of Legends is it doesn't run on Linux and it d…”

“And there was real insight that was generated there, which was that it really strengthened our belief that scale was the path to improving artificial intelligence. That with Dota two, the secret idea was that we could take huge amounts of experience and feed i…”