Pith. sign in

REVIEW 9 cited by

A Survey of Progress on Cooperative Multi-agent Reinforcement Learning in Open Environment

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2312.01058 v1 pith:R6LICOI7 submitted 2023-12-02 cs.MA

A Survey of Progress on Cooperative Multi-agent Reinforcement Learning in Open Environment

classification cs.MA
keywords researchcooperativemarlenvironmentsmulti-agentopenlearningprogress
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Multi-agent Reinforcement Learning (MARL) has gained wide attention in recent years and has made progress in various fields. Specifically, cooperative MARL focuses on training a team of agents to cooperatively achieve tasks that are difficult for a single agent to handle. It has shown great potential in applications such as path planning, autonomous driving, active voltage control, and dynamic algorithm configuration. One of the research focuses in the field of cooperative MARL is how to improve the coordination efficiency of the system, while research work has mainly been conducted in simple, static, and closed environment settings. To promote the application of artificial intelligence in real-world, some research has begun to explore multi-agent coordination in open environments. These works have made progress in exploring and researching the environments where important factors might change. However, the mainstream work still lacks a comprehensive review of the research direction. In this paper, starting from the concept of reinforcement learning, we subsequently introduce multi-agent systems (MAS), cooperative MARL, typical methods, and test environments. Then, we summarize the research work of cooperative MARL from closed to open environments, extract multiple research directions, and introduce typical works. Finally, we summarize the strengths and weaknesses of the current research, and look forward to the future development direction and research problems in cooperative MARL in open environments.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Offline Multi-agent Continual Cooperation via Skill Partition and Reuse

    cs.AI 2026-06 unverdicted novelty 7.0

    COMAD discovers and reuses coordination skills from mixed offline MARL data via auto-encoders and density-based estimation to achieve continual learning with better transfer.

  2. Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learning

    cs.CL 2026-06 unverdicted novelty 6.0

    EDV decouples execution, distillation by a third-party agent, and consensus verification to filter erroneous trajectories in LLM agent experience learning, outperforming baselines on tau2-bench, Mind2Web, and MMTB.

  3. Continual Quadruped Robots Coordination via Semantic Skill Discovery

    cs.RO 2026-06 unverdicted novelty 6.0

    Conquer is a retrieve-adapt-update semantic skill-library framework with a SAG backbone for continual multi-quadruped coordination, reporting 95.6% average success in simulations and real-world validation.

  4. PC3D: Zero-Shot Cooperation Across Variable Rosters via Personalized Context Distillation

    cs.LG 2026-05 unverdicted novelty 6.0

    PC3D trains decentralized policies to recover and use personalized coordination context from local histories, enabling higher returns than baselines on variable-roster cooperative MARL tasks with both seen and unseen ...

  5. Bridging MARL to SARL: An Order-Independent Multi-Agent Transformer via Latent Consensus

    cs.LG 2026-04 conditional novelty 6.0

    CMAT uses a transformer decoder to produce a high-level consensus vector in latent space, enabling simultaneous order-independent actions by all agents and optimization via single-agent PPO, with superior results on S...

  6. Autonomous Aerial Manipulation via Contextual Contrastive Meta Reinforcement Learning

    cs.LG 2026-06 unverdicted novelty 5.0

    Aco2 trains a quadrotor policy in simulation that adapts to diverse payload dynamics via latent context encoding and contrastive structuring, enabling zero-shot real-world deployment for autonomous aerial delivery.

  7. Cooperative Long Rope Skipping via Multi-Agent Reinforcement Learning

    cs.RO 2026-06 unverdicted novelty 5.0

    Marope applies hierarchical MARL with decentralized lower-level rope policies and a centralized scheduler to achieve cooperative long rope skipping on Unitree G1 humanoids in simulation and reality.

  8. Cross-Modal Navigation with Multi-Agent Reinforcement Learning

    cs.RO 2026-05 unverdicted novelty 5.0

    CRONA is a MARL framework that uses modality-specialized agents with auxiliary beliefs and a centralized multi-modal critic to achieve better performance and efficiency than single-agent baselines on visual-acoustic n...

  9. Multi-Agent Systems: From Classical Paradigms to Large Foundation Model-Enabled Futures

    cs.AI 2026-04 unverdicted novelty 4.0

    A survey comparing classical multi-agent systems with large foundation model-enabled multi-agent systems, showing how the latter enables semantic-level collaboration and greater adaptability.