DeepMind's StarCraft 2 A.I. Ranks Higher Than 99.8% of Human Players

DeepMind's StarCraft 2 A.I. Ranks Higher Than 99.8% of Human Players

If you lost against AlphaStar, we're sorry.

A few months ago, an A.I. racked up 90 games of StarCraft 2—30 each as the Protoss, Terran, and Zerg—and managed to reach the Grandmaster rank for all three races. The A.I., dubbed AlphaStar, is the product of years of research conducted by DeepMind. Today, DeepMind went public with AlphaStar by way of a new research paper in Nature and a more digestible summary on its website.

DeepMind's final iteration of AlphaStar ranked above 99.8% of all active StarCraft 2 players. As the highest achievable rank in StarCraft 2, Grandmaster rank consists of the top 200 one-versus-one players in a given region (AlphaStar's games were played on European servers).

It took a novel innovation in machine learning techniques in order to get AlphaStar into Grandmaster. A common problem with A.I. designed to converge on better strategies is that they can also effectively "forget" what it has learned and then lose to past versions of itself. In a league where every A.I. agent is trying to win, that can lead to a situation where the A.I. end up stuck cycling through a few strategies that happen to beat each other. To prevent this, DeepMind reworked its AlphaStar A.I. training league to include "exploiter agents" that prioritize seeking out flaws in the strategy of win-maximizing agents.

It's an approach inspired by how actual top players train, and AlphaStar benefitted from the input of StarCraft 2 pros. Team Liquid's Dario "TLO" Wünsch is listed as a co-author on the paper: in addition to playing matches against AlphaStar for the purposes of research, Wünsch helped inform the limits placed on AlphaStar to ensure it isn't discernibly making moves faster than a human player possibly could.

In 2017, DeepMind partnered with Blizzard to make an open source environment for A.I. research within StarCraft 2—all 90 of AlphaStar's game replays and an open access version of the new paper are also available for free download. DeepMind is owned by Alphabet, the parent holding company of Google.

As always, the key takeaway of research like this is the breakthrough in methodology. A few good players did have to lose games against AlphaStar in the wild for the sake of science, but if it's any consolation, those folks are still better than AlphaStar at doing literally anything besides playing StarCraft 2.

Sometimes we include links to online retail stores. If you click on one and make a purchase we may receive a small commission. See our terms & conditions.

Mathew Olson

Reporter

Mathew Olson is a writer formerly of Digg, where he blogged and reported about all things under the umbrella of internet culture (including games, of course). He lives in New York, grew up under rain clouds and the influence of numerous games studios in the Pacific Northwest, and will talk your ear off about Half-Life mods, Talking Heads or Twin Peaks if you let him.

Read this next

StarCraft is Getting a Kid-Friendly Graphics Pack Courtesy of Carbot Animations

StarCraft is getting a new look courtesy of the YouTube animation team.

BlizzCon Dates Revealed With Three Pricey Ticket Options

The convention is expanding this year, and so are some ticket prices.

Designing Diablo 2: Building Blizzard's Iconic World

In an excerpt of a chapter from the second installment of the Stay Awhile and Listen series, designers from Blizzard talk about the formation of some of Diablo 2's defining characteristics.

Behind the Scenes of StarCraft's Earliest Days

StarCraft lead Bob Fitch looks back on the days of "orcs in space," Reaver Drops, and competition with Total Annihilation.

Overwatch Devs Discuss Moira, Blizzard World, and Which Overwatch Heroes Play WarCraft

BlizzCon 2017 Interview: We sit down with lead writer Michael Chu and technical artist Hak Lee to talk about Overwatch's new hero and map.

More News

If You're Bad at Tetris 99, You Can Now Squad Up For Help

The puzzle-battle royale hybrid just got friendlier.

Resident Evil's Newest Survivor is a Living Homage to "Jill Sandwich"

Martin should probably stay away from small rooms with descending ceilings.

The CEO of Japanese Indie Publisher Dangen Entertainment Resigns As Allegations of Harassment Mount

Ben Judd is stepping back from the publisher he helped found, as well as his "other industry endeavors."

More on PC

Once the King of PC Gaming, MechWarrior is Now the Big Stompy Ghost of a Bygone Era

A legacy series returns, and there’s little else like it in gaming today.

Resident Evil's Newest Survivor is a Living Homage to "Jill Sandwich"

Martin should probably stay away from small rooms with descending ceilings.

The CEO of Japanese Indie Publisher Dangen Entertainment Resigns As Allegations of Harassment Mount

Ben Judd is stepping back from the publisher he helped found, as well as his "other industry endeavors."

The Game Awards is Launching a New Initiative Featuring Limited-Time Demos of Upcoming Games

Over a dozen games will have demos available for a limited time.

Disco Elysium: How to Get to the Fishing Village and Close the Water Lock

We show you how to get across the water and into Land's End in Disco Elysium.

More Strategy Games

Wargroove Developers Respond to Criticisms of Whitewashed Voice Cast

"We want to be honest about what happened."

Phoenix Point Review: Still Trying to Rise

XCom creator Julian Gollop returns to the genre he helped kick off, with uneven results.

Starship Troopers Will Become an RTS Next Year

For those still clamoring for Starship Troopers games.