Google reveals how DeepMind AI learned to play Quake III Arena like a pro

A team of Google DeepMind researchers have trained AI agents to 'act independently, yet learn to interact and cooperate with other agents' by letting them play CTF in (what else?) Quake III Arena.

It's been over twenty years since the debut of Quake, and developers are still learning how to build artificial intelligence that can play and learn a multiplayer first-person shooter the way a human can.

Devs curious about the state of AI in games should check out a new post over on Google's DeepMind blog which explains how a team of researchers have been trying to train AI agents to "act independently, yet learn to interact and cooperate with other agents" by letting them play (what else?) 1999's& Quake III Arena.

An aesthetically-modified Capture the Flag mode, specifically, with a special twist: the map layout changes from match to match in a way meant to push AI agents to master general strageties of play instead of map-specific tricks.

"The challenge for our agents is to learn directly from raw pixels to produce actions. This complexity makes first-person multiplayer games a fruitful and active area of research within the AI community," reads an excerpt of the post. "We train agents that learn and act as individuals, but which must be able to play on teams with and against any other agents, artificial or human."

As with earlier DeepMind agents trained on games, these Arena-trained AI "see" only what a player would see (that is, the raw pixels being displayed on the screen, not a direct feed of game data) and are not given any training on how to play the game before being "sat" in front of it and let loose. 

According to Google, the resulting "FTW" ("for the win") AI agent is capable of competing in multiplayer CTF matches at a very high level against either other bots or human opponents. In fact, it claims that after a 40-player tournament which included both human and AI players, the humans rated the AI players as "more collaborative" than their human compatriots.

You can read all the details (and mess around with some neat interactive visualizations) in the full DeepMind blog post.

Latest Jobs

Xbox Game Studios

Redmond, Washington
Technical Lighting Artist


Hamburg, Germany
Game Designer - Elvenar

Six Foot

Houston, TX
Six Foot Director, Player Relations

Hometopia Inc.

Lead Engineer
More Jobs   


Explore the
Subscribe to
Follow us

Game Developer Job Board

Game Developer Newsletter


Explore the

Game Developer Job Board

Browse open positions across the game industry or recruit new talent for your studio

Subscribe to

Game Developer Newsletter

Get daily Game Developer top stories every morning straight into your inbox

Follow us


Follow us @gamedevdotcom to stay up-to-date with the latest news & insider information about events & more