

Rather than training a single agent, we train a population of agents, which learn by playing with each other, providing a diversity of teammates and opponents.This is a challenging learning problem, and its solution is based on three general ideas for reinforcement learning:
#Quake 3 how to
Our agents must learn from scratch how to see, act, cooperate, and compete in unseen environments, all from a single reinforcement signal per match: whether their team won or not. Additionally, to level the playing field, our learning agents experience the world of CTF in a similar way to humans: they observe a stream of pixel images and issue actions through an emulated game controller. As a consequence, our agents are forced to acquire general strategies rather than memorising the map layout. To make things even more interesting, we consider a variant of CTF in which the map layout changes from match to match.

This complexity makes first-person multiplayer games a fruitful and active area of research within the AI community.įrom a multi-agent perspective, CTF requires players to both successfully cooperate with their teammates as well as compete with the opposing team, while remaining robust to any playing style they might encounter. The challenge for our agents is to learn directly from raw pixels to produce actions. These games represent the most popular genre of video game, and have captured the imagination of millions of gamers because of their immersive game play, as well as the challenges they pose in terms of strategy, tactics, hand-eye coordination, and team play. To investigate this problem, we look at 3D first-person multiplayer video games. This is an immensely difficult problem - because with co-adapting agents the world is constantly changing. This is a setting we call multi-agent learning: many individual agents must act independently, yet learn to interact and cooperate with other agents.
#Quake 3 full
Agents playing two other Quake III Arena multiplayer game modes on full-scale tournament maps: Harvester on the Future Crossings map (left) and One Flag Capture the Flag on the Ironwood map (right), with all the pickups and gadgets of the full game.īillions of people inhabit the planet, each with their own individual goals and actions, but still capable of coming together through teams, organisations and societies in impressive displays of collective intelligence.
