{"paper":{"title":"A Benchmark for Multi-Party Negotiation Games from Real Negotiation Data","license":"http://creativecommons.org/licenses/by/4.0/","headline":"No solver dominates multi-party negotiation games; performance varies with each game's structural properties.","cross_cats":["cs.AI","cs.LG"],"primary_cat":"cs.MA","authors_text":"Finale Doshi-Velez, Jonas Raedler, Leo Benac, Zilin Ma","submitted_at":"2026-03-14T18:12:06Z","abstract_excerpt":"Many real-world multi-party negotiations unfold as sequences of binding, action-level commitments rather than a single final outcome, yet this regime remains under-studied in existing benchmarks. We introduce a benchmark and evaluation framework for this setting, combining a configurable negotiation game generator with document-grounded instances derived from a climate negotiation exercise. We also provide several baseline solvers. Exact evaluation on small games and comparative evaluation on larger instances show that no solver dominates across regimes; performance depends on the structural p"},"claims":{"count":4,"items":[{"kind":"strongest_claim","text":"Exact evaluation on small games and comparative evaluation on larger instances show that no solver dominates across regimes; performance depends on the structural properties of the game.","source":"verdict.strongest_claim","status":"machine_extracted","claim_id":"C1","attestation":"unclaimed"},{"kind":"weakest_assumption","text":"That the configurable game generator and document-grounded instances from the climate negotiation exercise faithfully capture the dynamics of real-world multi-party sequential commitments.","source":"verdict.weakest_assumption","status":"machine_extracted","claim_id":"C2","attestation":"unclaimed"},{"kind":"one_line_summary","text":"A new benchmark for sequential multi-party negotiations from climate data shows no solver dominates and performance depends on game structure.","source":"verdict.one_line_summary","status":"machine_extracted","claim_id":"C3","attestation":"unclaimed"},{"kind":"headline","text":"No solver dominates multi-party negotiation games; performance varies with each game's structural properties.","source":"verdict.pith_extraction.headline","status":"machine_extracted","claim_id":"C4","attestation":"unclaimed"}],"snapshot_sha256":"42b7069177443434e668d1b82be2aa1904975702e1159bf695c8c40506b63b0e"},"source":{"id":"2603.14066","kind":"arxiv","version":2},"verdict":{"id":"dace04ce-b5bc-4cb1-9c66-33ca343e2b2b","model_set":{"reader":"grok-4.3"},"created_at":"2026-05-15T11:25:48.027159Z","strongest_claim":"Exact evaluation on small games and comparative evaluation on larger instances show that no solver dominates across regimes; performance depends on the structural properties of the game.","one_line_summary":"A new benchmark for sequential multi-party negotiations from climate data shows no solver dominates and performance depends on game structure.","pipeline_version":"pith-pipeline@v0.9.0","weakest_assumption":"That the configurable game generator and document-grounded instances from the climate negotiation exercise faithfully capture the dynamics of real-world multi-party sequential commitments.","pith_extraction_headline":"No solver dominates multi-party negotiation games; performance varies with each game's structural properties."},"references":{"count":18,"sample":[{"doi":"","year":null,"title":"Haris Aziz and Bart de Keijzer","work_id":"7aa995a2-48cd-4796-b183-59e3496790f2","ref_index":1,"cited_arxiv_id":"","is_internal_anchor":false},{"doi":"","year":2010,"title":"Complexity of coalition structure generation","work_id":"c498742e-edb1-445e-ac7b-c86795943253","ref_index":2,"cited_arxiv_id":"1101.1007","is_internal_anchor":true},{"doi":"10.1007/978-3-642-24696-8_7","year":null,"title":"DOI: 10.1007/978-3-642-24696-8_7. Max H. Bazerman, Jared R. Curhan, Don A. Moore, and Kathleen L. Valley. Negotiation.Annual Review of Psychology, 51(1):279–314,","work_id":"bcf52e45-3e34-4c12-ad14-f2894d402b93","ref_index":3,"cited_arxiv_id":"","is_internal_anchor":false},{"doi":"10.1146/annurev.psych.51.1.279","year":null,"title":"Centre of Competence on Humanitarian Negotiation.CCHN Field Manual on Humanitarian Nego- tiation","work_id":"3ac2260f-4fd2-419f-b4f3-90380fc0a3de","ref_index":4,"cited_arxiv_id":"","is_internal_anchor":false},{"doi":"","year":2026,"title":"org/document/cchn-field-manual-english/","work_id":"3fc13906-9fcf-40e6-8ae7-8aa7c6c30b74","ref_index":5,"cited_arxiv_id":"","is_internal_anchor":false}],"resolved_work":18,"snapshot_sha256":"b35e03c0485f7733b19d214fd34d4508a61dded1b26e938d546d13663b323a44","internal_anchors":2},"formal_canon":{"evidence_count":2,"snapshot_sha256":"dd9e386b15a9b23048de608e5428eef689e8904d7c49d73134119080a3002d37"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"}