pith:N3VODOHB
Beyond VMAF: Towards Application-Specific Metrics for Teleoperation Video
Retraining VMAF on teleoperation ratings improves alignment with human judgments by 15 to 27 percent.
arxiv:2605.13525 v1 · 2026-05-13 · cs.HC · cs.RO
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{N3VODOHBZDHJOPZDP32WTG2RYU}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
The retrained model demonstrated improved alignment with human ratings compared to the original 4K VMAF. In particular, RMSE decreased from 10.36 to 8.83, and MAD from 8.71 to 6.38, corresponding to improvements of 15% and 27%, respectively.
That the subjective ratings collected in the online study are representative of real teleoperation performance and that the retrained model generalizes beyond the tested Zenseact sequences and compression conditions.
Retraining VMAF on teleoperation-specific subjective ratings reduces RMSE from 10.36 to 8.83 and MAD from 8.71 to 6.38 compared to the standard model.
References
Receipt and verification
| First computed | 2026-05-18T02:44:24.325564Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
6eeae1b8e1c8ce973f237ef5699b51c50320b42cf7cf10e19e35968efc610808
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/N3VODOHBZDHJOPZDP32WTG2RYU \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 6eeae1b8e1c8ce973f237ef5699b51c50320b42cf7cf10e19e35968efc610808
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "aaeb991b8fd70188d110d47e60b748b05dec94b5d569db4a951f322b25e3b720",
"cross_cats_sorted": [
"cs.RO"
],
"license": "http://creativecommons.org/licenses/by-nc-nd/4.0/",
"primary_cat": "cs.HC",
"submitted_at": "2026-05-13T13:38:54Z",
"title_canon_sha256": "04621aee6f143a2fa7240cc5a94c82f848ee17eba22b9d3219f20f9f8909a704"
},
"schema_version": "1.0",
"source": {
"id": "2605.13525",
"kind": "arxiv",
"version": 1
}
}