Pith. sign in

REVIEW 1 cited by

Read It, Don't Watch It: Captioning Bug Recordings Automatically

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2302.00886 v1 pith:7LRBQTLF submitted 2023-02-02 cs.SE

classification cs.SE
keywords recordingsusercapdroiddevelopersactionsapproachautomaticallydescriptions
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Screen recordings of mobile applications are easy to capture and include a wealth of information, making them a popular mechanism for users to inform developers of the problems encountered in the bug reports. However, watching the bug recordings and efficiently understanding the semantics of user actions can be time-consuming and tedious for developers. Inspired by the conception of the video subtitle in movie industry, we present a lightweight approach CAPdroid to caption bug recordings automatically. CAPdroid is a purely image-based and non-intrusive approach by using image processing and convolutional deep learning models to segment bug recordings, infer user action attributes, and generate subtitle descriptions. The automated experiments demonstrate the good performance of CAPdroid in inferring user actions from the recordings, and a user study confirms the usefulness of our generated step descriptions in assisting developers with bug replay.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. LLMShot: Reducing snapshot testing maintenance via LLMs

    cs.SE 2025-07 conditional novelty 5.0 of 10

    Gemma3 vision-language models can label UI snapshot test failure causes with 84% recall on a small synthetic iOS dataset, but prompt-based selective ignore is unreliable.

Pith tools