pith. sign in

arxiv: 2512.03042 · v3 · pith:5NAHHZAAnew · submitted 2025-12-02 · 💻 cs.CV · cs.AI

PPTArena: A Benchmark for PowerPoint Editing

classification 💻 cs.CV cs.AI
keywords pptarenaagentsbenchmarkeditingpowerpointediteditspptpilot
0
0 comments X
read the original abstract

We introduce PPTArena, a benchmark for PowerPoint editing that evaluates how agents modify real slides from natural-language instructions. Unlike benchmarks that rely on image-PDF renderings or text-to-slide generation, PPTArena features 100 decks with over 1,300 human-curated edits across 2,125 slides, spanning text, charts, animations, and professional master styles. Each edit pairs a ground-truth deck with a target rubric and is scored by two Vision-Language Model (VLM) judges: one rates instruction following from structural diffs, the other visual quality from slide images. On top of this benchmark, we present PPTPilot, a structure-aware agent that plans semantic edit sequences, routes between programmatic tools and deterministic XML operations, and verifies each result in an iterative plan-edit-check loop. PPTPilot outperforms strong VLM-based agents by more than 10 percentage points on compound, layout-sensitive, and cross-slide edits, with large gains in visual fidelity and deck-wide consistency. Despite this, all agents still struggle on long-horizon, document-scale tasks, underscoring how hard reliable PowerPoint editing remains. We publicly release our code at https://github.com/michaelofengend/PPTArena .

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. X+Slides: Benchmarking Audience-Conditioned Slide Generation

    cs.AI 2026-06 unverdicted novelty 6.0

    X+Slides is a new benchmark that measures audience-conditioned slide generation quality via 8,133 source-grounded probes across 113 topics, reporting Audience Coverage, Domain-wise Coverage, Efficiency, and Correctnes...

  2. Learn from Weaknesses: Automated Domain Specialization for Small Computer-Use Agents

    cs.LG 2026-05 unverdicted novelty 6.0

    LearnWeak specializes small CUAs via weakness detection by a reference agent, targeted task synthesis, and error-aware training, delivering 11+ point gains on OSWorld.

  3. LLMs Corrupt Your Documents When You Delegate

    cs.CL 2026-04 unverdicted novelty 6.0

    LLMs corrupt an average of 25% of document content during long delegated editing workflows across 52 domains, even frontier models, and agentic tools do not mitigate the issue.

  4. DeepSlide: From Artifacts to Presentation Delivery

    cs.AI 2026-04 unverdicted novelty 6.0

    DeepSlide introduces a multi-agent system for full presentation preparation that matches baselines on slide quality but improves narrative flow, pacing, and script synergy via a new dual-scoreboard benchmark.