REVIEW 3 major objections 9 references
Designing each slide in a high-level visual plan before writing code yields more coherent, preferred presentations than templates or direct code generation.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
2026-07-13 08:51 UTC pith:RNXFQJKT
load-bearing objection Solid systems package for template-free slides with real human preference wins; the “design first” causal story is not cleanly isolated from pipeline depth. the 3 major comments →
Design First, Code Later: Aesthetically Pleasing Template-Free Slides Generation
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
DeepSlides establishes that decoupling slide-page design from implementation inside a hierarchical, template-free pipeline improves visual layout, hierarchy, and color and raises human preference relative to template-driven and direct code/HTML baselines. Design lives in a semantic specification; a coder module only then compiles that plan into runnable Python/PPTX, with iterative checks on completeness, compliance, and aesthetics. Supporting that claim, the authors release SlideDesign and train SlideQwens designer–coder pairs with multi-agent reinforcement learning.
What carries the argument
DeepSlides: a hierarchical design-first workflow that separates slides-level style and page-level design (background, layout, content) from code realization, optimized by multi-agent RL between a designer and a coder.
Load-bearing premise
The quality gains are mainly caused by decoupling design from code, not by extra retrieval, multi-step prompting, more refinement stages, or judges that reward the same aesthetics the system was trained on.
What would settle it
Match total compute, retrieval, and refinement steps between a design-first pipeline and a strong direct-code baseline, then re-run the same blind human ranking and layout/hierarchy scores; if the preference gap disappears, the decoupling claim fails.
If this is right
- Template-free hierarchical design can outrank both open academic pipelines and commercial tools on human Top-1 preference in comparable head-to-head tests.
- Separating designer and coder roles reduces error propagation and lets aesthetics and executability be optimized on different rewards.
- Automatically generated design–code pairs are enough to train small specialized models that emit runnable PPTX from page content and style constraints.
- Completeness, compliance, and aesthetics feedback can drive both iterative page revision and multi-agent RL without fixed layout templates.
Where Pith is reading between the lines
- The same design-spec-then-render split likely helps other structured multimodal authoring tasks (posters, reports, UI mockups) where layout intent is currently fused with rendering code.
- If automatic judges and training rewards share the same aesthetic rubric, part of the reported lift may be judge-alignment; hold-out human-only aesthetic tests would isolate that.
- A portable design specification could become an interchange layer so one visual plan drives PPTX, HTML, or native app renderers.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes DeepSlides, a hierarchical, template-free slide-generation workflow that first produces slides-level style and page-level design specifications (background, layout, content layers) and only then compiles them into editable PPTX via Python, with iterative completeness/compliance/aesthetics feedback. It also releases SlideDesign (topics under a Field-of-Science taxonomy with paired design/code resources) and trains SlideQwens designer/coder models via SFT plus multi-agent RL (rewards in Eqs. 1–3). Empirically, with Claude Haiku as the main backbone, DeepSlides scores highest on average VLM visual metrics in Table 2 and wins human Top-1 preference against open-source and commercial baselines (Figs. 8–9), with additional style ratings (Fig. 10) and small-model training gains (Table 3).
Significance. Automated slide generation is a practically important structured multimodal problem where current systems are either template-bound or code-first and often aesthetically weak. A design-first, template-free pipeline that still emits editable PPTX is a clear systems contribution; releasing code and a multi-disciplinary dataset, plus showing that a 0.6B backbone can be specialized for design and coding, are concrete assets for the community. Human preference results (anonymized order, open-source and commercial comparators) are stronger evidence of perceived quality than VLM scores alone. If the claimed benefit of decoupling design from implementation can be cleanly isolated, the paper would offer a reusable architectural pattern for other layout-constrained generation tasks, not only a stronger end-to-end demo.
major comments (3)
- The paper’s central framing (§1, §3, research question (2) in §5) attributes gains to decoupling design from implementation, but the experiments evaluate the full DeepSlides stack (DeepResearch/outline, web content expansion, slides-level style, three-layer design, iterative checker loop, then coding) against Direct, Auto-Slides, and EvoPresent (Table 2; Figs. 8–10). Shared research reports partially align inputs (§5.1), yet page-level expansion, multi-layer design, and design–eval iteration remain DeepSlides-specific. There is no controlled ablation that holds content, retrieval, and iteration budget fixed while only toggling an intermediate design specification versus joint design+code emission. Table 3 (SFT vs SFT+MARL) improves small-model executability/visual scores but does not test decoupling. Without that isolation, the causal claim for “design first, code later” is not establish
- Evaluator alignment weakens the independence of the aesthetic evidence. The MARL designer reward RD (§4.2, Eqs. 2–3) combines completeness, compliance, and aesthetics gated by implementation completeness from a VLM reward model; the main automatic evaluation (§5.2, Table 2) again uses a VLM judge on clarity/coherence/layout/hierarchy/color—closely related axes. Human preference (Figs. 8–10) is a better external signal, but the paper still leans on VLM scores to claim superiority on layout/hierarchy/color. Primary claims about visual quality should be anchored in human ratings (with uncertainty), with VLM metrics clearly secondary, or an independent judge/protocol should be shown not to share the training reward criteria.
- Human evaluation is directionally strong but under-specified for the breadth of the claim. Twenty volunteers rank/score 40 topics (20 per base model) with anonymized order (Figs. 8–10; Appendix D), yet the manuscript does not report inter-rater agreement, confidence intervals on win rates, or topic-level variance, nor how commercial systems (Kimi, Manus) were prompted/configured for fair topic-matched comparison. Given that Top-1 share and pairwise wins are the main support for real-world superiority, these statistics and protocol details are load-bearing for the preference claim.
Circularity Check
No circular derivation: DeepSlides is an empirical systems claim evaluated against external baselines and human raters, not a result forced by its own definitions or fits.
full rationale
This paper does not present a mathematical derivation chain in which a claimed prediction reduces to its inputs by construction. The load-bearing claims are empirical: a hierarchical, template-free design-then-code workflow (DeepSlides), a constructed dataset (SlideDesign), and MARL-trained SlideQwens models outperform baselines on objective render metrics, VLM-as-judge scores, and human preference. Design rewards (Eqs. 1–3) and VLM judges share aesthetic language, but the main Table 2 / human studies run Claude-backed DeepSlides against external systems without using the trained reward as the reported outcome, so automatic wins are not forced by the training objective. Human Top-1 preference (20 volunteers, anonymized ranking) is an independent external signal. Self-citation of ReMA is methodological inspiration only, not a uniqueness theorem that forbids alternatives. Training data filtered for executable code does not make baseline comparisons tautological. Causal confounding (pipeline depth vs. decoupling) is a validity concern, not circularity under the stated patterns. Score 0.
Axiom & Free-Parameter Ledger
free parameters (3)
- Designer reward weights α, β, γ
- SFT/MARL hyperparameters
- Balance metric mixture weight λ and Gaussian σ
axioms (4)
- ad hoc to paper Decoupling high-level design from executable PPTX code improves aesthetic quality without harming content quality relative to joint or template pipelines.
- domain assumption Completeness, compliance, and aesthetics scores from a VLM reward/judge are valid enough proxies to train and rank slide quality.
- domain assumption Standard supervised fine-tuning plus multi-agent RL (ReMA-style alternating designer/coder) can specialize small LLMs for structured multimodal generation.
- domain assumption Python-pptx editable PPTX is the appropriate target representation versus HTML/LaTeX for real-world slide workflows.
invented entities (3)
-
DeepSlides hierarchical workflow (slides-level style + three-layer page design + coder + checker loop)
no independent evidence
-
SlideDesign dataset
independent evidence
-
SlideQwens (Designer and Coder models)
no independent evidence
Cite this review
Pith. "Pith review of Design First, Code Later: Aesthetically Pleasing Template-Free Slides Generation." pith.science (2026). https://pith.science/paper/RNXFQJKT
@misc{pith2026260526451,
author = {Pith},
title = {Pith review of: Design First, Code Later: Aesthetically Pleasing Template-Free Slides Generation},
year = {2026},
howpublished = {\url{https://pith.science/paper/RNXFQJKT}},
note = {Machine review of arXiv:2605.26451}
}
read the original abstract
Producing presentation slides automatically entails coordinating narrative structure with page-level graphic design under strict spatial constraints. For such structured multimodal tasks, a well-organized design process is essential to ensure the final quality of slides. Existing approaches rely on fixed templates or directly emit executable code, thereby both limiting the creative layout-design capabilities of LLMs and bypassing the essential slide-page design step. To address these limitations, this paper (1) proposes a hierarchical slides generation workflow, DeepSlides, that systematically organizes slide design tasks without any predefined template or style, decoupling slide-page design from implementation; (2) introduces SlideDesign, a dataset tailored specifically for slides generation tasks; and (3) presents a multi-agent reinforcement learning training paradigm and trains a couple of models, SlideQwens, for slide design and implementation. Experimental results demonstrate that our proposed framework outperforms baseline methods on evaluated metrics and achieves superior performance in human preference evaluations. The dataset and code are available at https://github.com/sxswz213/DeepSlides.
Reference graph
Works this paper leans on
-
[1]
Presenting a paper is an art: Self-improvement aesthetic agents for academic presentations.arXiv preprint arXiv:2510.05571. Manus. 2025. Manus. Accessed: 2025-12-02. Fanqing Meng, Lingxiao Du, Zongkai Liu, Zhixiang Zhou, Quanfeng Lu, Daocheng Fu, Tiancheng Han, Botian Shi, Wenhai Wang, Junjun He, Kaipeng Zhang, Ping Luo, Yu Qiao, Qiaosheng Zhang, and Wenq...
arXiv 2025
-
[2]
Slidecoder: Layout-aware rag-enhanced hi- erarchical slide generation from design.Preprint, arXiv:2506.07964. Ziyu Wan, Yunxiang Li, Xiaoyu Wen, Yan Song, Hanjing Wang, Linyi Yang, Mark Schmidt, Jun Wang, Weinan Zhang, Shuyue Hu, and 1 others
-
[3]
Rema: Learning to meta-think for llms with multi-agent reinforcement learning.arXiv preprint arXiv:2503.09501. Xin Wang, Zhiyao Cui, Hao Li, Ya Zeng, Chenxu Wang, Ruiqi Song, Yihang Chen, Kun Shao, Qiaosheng Zhang, Jinzhuo Liu, Siyue Ren, Shuyue Hu, and Zhen Wang. 2025. Perpilot: Personalizing vlm-based mobile agents via memory and exploration.Preprint, a...
Pith/arXiv arXiv 2025
-
[4]
Import the necessary libraries
-
[5]
Create the slides and ensure the widescreen standard aspect ratio: 16:9 (13.33 inches × 7.5 inches)
-
[6]
According to the detailed description, add the title, bullet points, and images at specified positions; set fonts and styles; ex- plicitly set the size of each element to pre- vent overlap/occlusion; ensure text wraps automatically
-
[7]
Do not reserve any positions for any images that are not provided, and do not use text descriptions to fill the gaps
Only the provided image URLs can be used. Do not reserve any positions for any images that are not provided, and do not use text descriptions to fill the gaps. Or you can also manually create some flowcharts using various graphics, but don’t just leave an empty space or just provide a textual description
-
[8]
All the text should be placed on the top layer
-
[9]
Note: output Python code only, do not out- put any other text
Save the file as: <Save target> Previous code and errors (if any): <previous code> <error message> Please provide complete, executable Python code based on this information. Note: output Python code only, do not out- put any other text. Code will be save in utf-8 encoding. B Dataset We allocate 10 topics per secondary field (420 top- ics total). Our relea...
This paper was first reviewed by grok-4.5 on July 13, 2026.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.