Pith Number

pith:7DPWLG4F

pith:2026:7DPWLG4FF23XDGKDQ67UECJ77N

not attested not anchored not stored refs resolved

Evaluating Design Video Generation: Metrics for Compositional Fidelity

Adrienne Deganutti, Dingning Cao, Elad Hirsch, Jaejung Seol, Purvanshi Mehta

Design video generation now has an automated evaluation framework using four fidelity metrics to replace subjective human judgments.

arxiv:2605.16223 v1 · 2026-05-15 · cs.GR · cs.AI · cs.CV

Open paper page JSON Open Graph Bundle Merged state What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{7DPWLG4FF23XDGKDQ67UECJ77N}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

This paper provides a fully automated evaluation framework organized across four dimensions: layout fidelity, motion correctness, temporal quality, and content fidelity. This eliminates the reliance on subjective human evaluation and establishes a common basis for benchmarking progress in the field.

C2weakest assumption

That the four proposed dimensions and their automated implementations can fully and accurately capture the structured constraints of design animation (specific component motions, stability of non-animated regions, and layout preservation) without requiring human validation or missing key failure modes.

C3one line summary

Proposes a four-dimensional automated evaluation framework for compositional fidelity in design video generation to enable objective benchmarking without human evaluators.

References

23 extracted · 23 resolved · 0 Pith anchors

[1] Distractor-aware

[2] Hirsch, Elad and Yadav, Shubham and Garg, Mohit and Mehta, Purvanshi , journal=. L

[3] Postercraft: Rethinking high-quality aesthetic poster generation in a unified framework

[4] Deka, Biplab and Huang, Zifeng and Franzen, Chad and Hibschman, Joshua and Afergan, Daniel and Li, Yang and Nichols, Jeffrey and Kumar, Ranjitha , booktitle=. Rico:

[5] Yamaguchi, Kota , booktitle=. Canvasvae:

Formal links

2 machine-checked theorem links

Receipt and verification

First computed	2026-05-20T00:01:58.876482Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

f8df659b852eb771994387bf42093ffb5a361ff75ada1c839566055dc0515e85

Aliases

arxiv: 2605.16223 · arxiv_version: 2605.16223v1 · doi: 10.48550/arxiv.2605.16223 · pith_short_12: 7DPWLG4FF23X · pith_short_16: 7DPWLG4FF23XDGKD · pith_short_8: 7DPWLG4F

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/7DPWLG4FF23XDGKDQ67UECJ77N \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: f8df659b852eb771994387bf42093ffb5a361ff75ada1c839566055dc0515e85

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "45918ae41c83a2cf5cf115ce9fa9a58c52e61427ae2b52e8b220ec7f4d8a8a73",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.CV"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.GR",
    "submitted_at": "2026-05-15T17:34:05Z",
    "title_canon_sha256": "c54d746dc2d563fa366ac36d0b1750648cb9222e3dfe4e31f029e78dbb69d314"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2605.16223",
    "kind": "arxiv",
    "version": 1
  }
}