REVIEW 1 cited by
Learning to Segment Actions from Observation and Narration
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Learning to Segment Actions from Observation and Narration
read the original abstract
We apply a generative segmental model of task structure, guided by narration, to action segmentation in video. We focus on unsupervised and weakly-supervised settings where no action labels are known during training. Despite its simplicity, our model performs competitively with previous work on a dataset of naturalistic instructional videos. Our model allows us to vary the sources of supervision used in training, and we find that both task structure and narrative language provide large benefits in segmentation quality.
Forward citations
Cited by 1 Pith paper
-
REMAP: Regularized Matching and Partial Alignment of Video Embeddings
REMAP applies regularized fused partial Gromov-Wasserstein optimal transport to align video embeddings for unsupervised procedure learning on noisy instructional videos.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.