Pith. sign in

REVIEW 19 cited by

Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms in Cooperative Tasks

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2006.07869 v4 pith:ABIRKBBT submitted 2020-06-14 cs.LG cs.AIcs.MAstat.ML

Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms in Cooperative Tasks

classification cs.LG cs.AIcs.MAstat.ML
keywords learningmulti-agentalgorithmstasksdifferentapproachescooperativedeep
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Multi-agent deep reinforcement learning (MARL) suffers from a lack of commonly-used evaluation tasks and criteria, making comparisons between approaches difficult. In this work, we provide a systematic evaluation and comparison of three different classes of MARL algorithms (independent learning, centralised multi-agent policy gradient, value decomposition) in a diverse range of cooperative multi-agent learning tasks. Our experiments serve as a reference for the expected performance of algorithms across different learning tasks, and we provide insights regarding the effectiveness of different learning approaches. We open-source EPyMARL, which extends the PyMARL codebase to include additional algorithms and allow for flexible configuration of algorithm implementation details such as parameter sharing. Finally, we open-source two environments for multi-agent research which focus on coordination under sparse rewards.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 19 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Interaction-Breaking Adversarial Learning Framework for Robust Multi-Agent Reinforcement Learning

    cs.LG 2026-05 unverdicted novelty 7.0

    IBAL framework constructs information-theoretic adversarial attacks on agent observations and actions to train MARL agents that remain robust to interaction disruptions and agent-missing scenarios.

  2. Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory

    cs.CL 2025-11 unverdicted novelty 7.0

    Evo-Memory is a new benchmark for self-evolving memory in LLM agents across task streams, with baseline ExpRAG and proposed ReMem method that integrates reasoning, actions, and memory updates for continual improvement.

  3. Contract-Based Compositional Shielding for Safe Multi-Agent Reinforcement Learning

    cs.LG 2026-06 conditional novelty 6.0

    Certified local LTL_safe contracts, jointly fixed-point checked and selected by a bandit, recover coordinated safe team policies under decentralised multi-agent RL execution.

  4. CINOC: Cardinality-Invariant Neural Operator Policies for Scalable PDE Control

    eess.SY 2026-05 unverdicted novelty 6.0

    CINOC policies trained on small agent populations exhibit cardinality invariance enabling zero-shot transfer to larger populations in PDE control via mean-field theory.

  5. Interaction-Breaking Adversarial Learning Framework for Robust Multi-Agent Reinforcement Learning

    cs.LG 2026-05 unverdicted novelty 6.0

    The IBAL framework builds information-theoretic attacks that break agent interactions in MARL and trains policies to stay robust under observation and action perturbations.

  6. Robust Instruction Compliance in Cooperative Multi-Agent Reinforcement Learning

    cs.AI 2026-05 unverdicted novelty 6.0

    MAVIC corrects Bellman backups at instruction boundaries by adjusting the incoming objective and restoring continuation value, enabling consistent estimation under stochastic instruction switching in cooperative MARL.

  7. Robust Instruction Compliance in Cooperative Multi-Agent Reinforcement Learning

    cs.AI 2026-05 unverdicted novelty 6.0

    MAVIC corrects Bellman backups at instruction boundaries by adjusting the incoming objective and restoring continuation value, enabling consistent estimation under stochastic instruction switching in a unified policy.

  8. DelAC: A Multi-agent Reinforcement Learning of Team-Symmetric Stochastic Games

    cs.MA 2026-05 unverdicted novelty 6.0

    Team-symmetric games always have team-symmetric Nash equilibria solvable via linear complementarity problems, and the DelAC actor-critic MARL algorithm outperforms existing methods in simulations.

  9. Rethinking Ratio-Based Trust Regions for Policy Optimization in Multi-Agent Reinforcement Learning

    cs.LG 2026-05 unverdicted novelty 6.0

    MARS replaces additive clipping and soft penalties in multi-agent trust-region methods with a symmetric geometric barrier, matching or exceeding MAPPO and MASPO performance across 47 tasks in eight environments.

  10. SACHI: Structured Agent Coordination via Holistic Information Integration in Multi-Agent Reinforcement Learning

    cs.LG 2026-05 unverdicted novelty 6.0

    SACHI uses graph transformer convolutions on inter-agent coordination graphs to enrich partial-observation agents with content-dependent teammate information, yielding statistically significant gains over baselines in...

  11. SACHI: Structured Agent Coordination via Holistic Information Integration in Multi-Agent Reinforcement Learning

    cs.LG 2026-05 conditional novelty 6.0

    SACHI enriches agent representations via graph transformer convolutions over inter-agent graphs to enable holistic information integration, outperforming baselines across five cooperative tasks with statistical significance.

  12. SOAR: Real-Time Joint Optimization of Order Allocation and Robot Scheduling in Robotic Mobile Fulfillment Systems

    cs.AI 2026-05 unverdicted novelty 6.0

    SOAR is a unified DRL method using soft allocations, event-driven MDP, and heterogeneous graph transformers that cuts global makespan by 7.5% and average order completion time by 15.4% at sub-100ms latency in RMFS.

  13. Scalable Neighborhood-Based Multi-Agent Actor-Critic

    cs.LG 2026-04 unverdicted novelty 6.0

    MADDPG-K scales centralized critics in multi-agent RL by limiting each critic to k-nearest neighbors under Euclidean distance, yielding constant input size and competitive performance.

  14. Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory

    cs.CL 2025-11 unverdicted novelty 6.0

    Evo-Memory is a new streaming benchmark and evaluation framework for self-evolving memory in LLM agents, unifying over ten memory modules and introducing the ReMem pipeline for continual improvement on multi-turn and ...

  15. AdaFair-MARL: Enforcing Adaptive Fairness Constraints in Multi-Agent Reinforcement Learning

    cs.LG 2025-11 unverdicted novelty 6.0

    AdaFair-MARL enforces workload fairness as an explicit second-order cone constraint in cooperative MARL via adaptive primal-dual optimization, achieving near-perfect constraint satisfaction while preserving team performance.

  16. Optimistic {\epsilon}-Greedy Exploration for Cooperative Multi-Agent Reinforcement Learning

    cs.MA 2025-02 unverdicted novelty 6.0

    Optimistic ε-Greedy Exploration adds decoupled optimistic networks that converge in probability to maximum returns and samples from them with probability ε to increase optimal joint-action frequency in CTDE MARL.

  17. From Pixels to Digital Agents: An Empirical Study on the Taxonomy and Technological Trends of Reinforcement Learning Environments

    cs.AI 2026-03 unverdicted novelty 5.0

    An empirical literature analysis reveals a bifurcation in RL environments into Semantic Prior (LLM-dominated) and Domain-Specific Generalization ecosystems with distinct cognitive fingerprints.

  18. Centralized Adaptive Sampling for Reliable Co-Training of Independent Multi-Agent Policies

    cs.LG 2025-08 unverdicted novelty 5.0

    CoSER adaptively samples joint actions in CTDE MARL to reduce sampling error relative to the joint on-policy distribution, empirically improving reliability of independent policy gradient convergence.

  19. Low Variance Trust Region Optimization with Independent Actors and Sequential Updates in Cooperative Multi-agent Reinforcement Learning

    cs.LG 2026-06 unverdicted novelty 4.0

    Proposes a clipping objective for sequential trust-region updates in independent-actor cooperative MARL that yields a monotonic improvement bound and sub-linear convergence to epsilon-Nash equilibria while reducing ad...