Pith. sign in

REVIEW 13 cited by

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1809.02627 v2 pith:HYCLM5GH submitted 2018-09-07 cs.LG cs.AIcs.NEstat.ML

Unity: A General Platform for Intelligent Agents

classification cs.LG cs.AIcs.NEstat.ML
keywords unitygeneralplatformsenvironmentsagentsartificialcomplexityexisting
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Recent advances in artificial intelligence have been driven by the presence of increasingly realistic and complex simulated environments. However, many of the existing environments provide either unrealistic visuals, inaccurate physics, low task complexity, restricted agent perspective, or a limited capacity for interaction among artificial agents. Furthermore, many platforms lack the ability to flexibly configure the simulation, making the simulated environment a black-box from the perspective of the learning system. In this work, we propose a novel taxonomy of existing simulation platforms and discuss the highest level class of general platforms which enable the development of learning environments that are rich in visual, physical, task, and social complexity. We argue that modern game engines are uniquely suited to act as general platforms and as a case study examine the Unity engine and open source Unity ML-Agents Toolkit. We then survey the research enabled by Unity and the Unity ML-Agents Toolkit, discussing the kinds of research a flexible, interactive and easily configurable general platform can facilitate.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 13 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. R2D-RL: A RoboCup 2D Soccer Environment for Multi-Agent Reinforcement Learning

    cs.AI 2026-06 unverdicted novelty 7.0

    R2D-RL supplies a Python MARL interface to RCSS2D with shared-memory sync, scenario and full-field support, EPV rewards, and baseline results.

  2. ARC-RL: A Reinforcement Learning Playground Inspired by ARC Raiders

    cs.RO 2026-05 unverdicted novelty 7.0

    ARC-RL provides four new MuJoCo continuous-control environments with hexapod and quadruped morphologies inspired by ARC Raiders, a unified multi-component reward without motion capture, CPG expert demonstrators, and e...

  3. An Exploration of Collision-based Enemy Morphology Generation

    cs.AI 2026-06 unverdicted novelty 6.0

    Three collision-based methods for generating enemy morphologies in games perform as well or better than an evolutionary robotics baseline.

  4. ARC-RL: A Reinforcement Learning Playground Inspired by ARC Raiders

    cs.RO 2026-05 accept novelty 6.0

    ARC-RL is a new suite of four MuJoCo continuous-control environments featuring game-inspired hexapod and quadruped morphologies, a single closed-form multi-component reward function, CPG demonstrators, and empirical c...

  5. Infernux: A Python-Native Game Engine with JIT-Accelerated Scripting

    cs.GR 2026-04 unverdicted novelty 6.0

    Infernux is a game engine that uses batch data bridging and Numba JIT to make Python scripting performant within a Vulkan C++ core.

  6. FootsiesGym: A Fighting Game Benchmark for Two-Player Zero-Sum Imperfect-Information Games

    cs.AI 2026-07 accept novelty 5.0

    FootsiesGym is an open-source, vectorized fighting-game benchmark for two-player zero-sum imperfect-information RL that isolates non-transitive neutral-game dynamics while remaining tractable on standard hardware.

  7. REAP: Reinforcement-Learning End-to-End Autonomous Parking with Gaussian Splatting Simulator for Real2Sim2Real Transfer

    cs.RO 2026-05 unverdicted novelty 5.0

    REAP trains an end-to-end SAC policy with behavior cloning and collision penalties inside a 3DGS Real2Sim simulator and transfers it to physical vehicles, succeeding in narrow mechanical parking slots.

  8. A High-Throughput Compute-Efficient POMDP Hide-And-Seek-Engine (HASE) for Multi-Agent Operations

    cs.MA 2026-04 unverdicted novelty 5.0

    A C++ Dec-POMDP simulator using data-oriented design and zero-copy PyTorch integration achieves up to 33 million steps per second on a 16-core CPU, enabling multi-agent policy training in minutes with PPO, DQN, and SAC.

  9. From Pixels to Digital Agents: An Empirical Study on the Taxonomy and Technological Trends of Reinforcement Learning Environments

    cs.AI 2026-03 unverdicted novelty 5.0

    An empirical literature analysis reveals a bifurcation in RL environments into Semantic Prior (LLM-dominated) and Domain-Specific Generalization ecosystems with distinct cognitive fingerprints.

  10. Self-Paced Curriculum Reinforcement Learning for Autonomous Superbike Racing in Simulation

    cs.RO 2026-06 unverdicted novelty 4.0

    SPDL combined with SAC improves training speed, lap times, and stability over plain SAC for autonomous superbike racing across multiple tracks and models in simulation.

  11. ORRB -- OpenAI Remote Rendering Backend

    cs.GR 2019-06 unverdicted novelty 4.0

    ORRB is an open-source remote rendering backend that pairs Unity3d with MuJoCo for high-throughput, customizable visual domain randomization in robotics environments.

  12. NVIDIA Isaac Sim: Enabling Scalable, GPU-Accelerated Simulation for Robotics

    cs.RO 2026-06 unverdicted novelty 2.0

    A survey reviewing the architecture, usage patterns, and limitations of NVIDIA Isaac Sim across robotics domains.

  13. An Introduction to Deep Reinforcement and Imitation Learning

    cs.RO 2025-12 unverdicted novelty 1.0

    The paper delivers a concise, self-contained tutorial on foundational DRL algorithms including REINFORCE and PPO and DIL methods including behavioral cloning, DAgger, and GAIL for embodied agents.