Pith. sign in

ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learning

4 Pith papers cite this work. Polarity classification is still indexing.

4 Pith papers citing it
abstract

The recent advances in deep neural networks have led to effective vision-based reinforcement learning methods that have been employed to obtain human-level controllers in Atari 2600 games from pixel data. Atari 2600 games, however, do not resemble real-world tasks since they involve non-realistic 2D environments and the third-person perspective. Here, we propose a novel test-bed platform for reinforcement learning research from raw visual information which employs the first-person perspective in a semi-realistic 3D world. The software, called ViZDoom, is based on the classical first-person shooter video game, Doom. It allows developing bots that play the game using the screen buffer. ViZDoom is lightweight, fast, and highly customizable via a convenient mechanism of user scenarios. In the experimental part, we test the environment by trying to learn bots for two scenarios: a basic move-and-shoot task and a more complex maze-navigation problem. Using convolutional deep neural networks with Q-learning and experience replay, for both scenarios, we were able to train competent bots, which exhibit human-like behaviors. The results confirm the utility of ViZDoom as an AI research platform and imply that visual reinforcement learning in 3D realistic first-person perspective environments is feasible.

representative citing papers

OpenAI Gym

cs.LG · 2016-06-05 · accept · novelty 7.0

OpenAI Gym introduces a common interface for reinforcement learning environments and a results-sharing website to enable consistent algorithm comparisons.

ORRB -- OpenAI Remote Rendering Backend

cs.GR · 2019-06-26 · unverdicted · novelty 4.0

ORRB is an open-source remote rendering backend that pairs Unity3d with MuJoCo for high-throughput, customizable visual domain randomization in robotics environments.

Ludii as a Competition Platform

cs.AI · 2019-06-29 · unverdicted · novelty 3.0

Ludii is proposed as a competition platform for AI research on traditional strategy games, with comparisons to existing general game playing systems.

citing papers explorer

Showing 4 of 4 citing papers.

  • OpenAI Gym cs.LG · 2016-06-05 · accept · none · ref 15

    OpenAI Gym introduces a common interface for reinforcement learning environments and a results-sharing website to enable consistent algorithm comparisons.

  • Gymnasium: A Standard Interface for Reinforcement Learning Environments cs.LG · 2024-07-24 · accept · none · ref 21

    Gymnasium establishes a standardized API for RL environments to improve interoperability, reproducibility, and ease of development in reinforcement learning.

  • ORRB -- OpenAI Remote Rendering Backend cs.GR · 2019-06-26 · unverdicted · none · ref 7 · internal anchor

    ORRB is an open-source remote rendering backend that pairs Unity3d with MuJoCo for high-throughput, customizable visual domain randomization in robotics environments.

  • Ludii as a Competition Platform cs.AI · 2019-06-29 · unverdicted · none · ref 14 · internal anchor

    Ludii is proposed as a competition platform for AI research on traditional strategy games, with comparisons to existing general game playing systems.