WhACC, a two-stage ResNet50V2 and LightGBM classifier with engineered temporal features, matches expert human whisker-touch labeling and reduces curation effort by over 98%.
Learning to Localize Temporal Events in Large-scale Video Data
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
We address temporal localization of events in large-scale video data, in the context of the Youtube-8M Segments dataset. This emerging field within video recognition can enable applications to identify the precise time a specified event occurs in a video, which has broad implications for video search. To address this we present two separate approaches: (1) a gradient boosted decision tree model on a crafted dataset and (2) a combination of deep learning models based on frame-level data, video-level data, and a localization model. The combinations of these two approaches achieved 5th place in the 3rd Youtube-8M video recognition challenge.
citation-role summary
citation-polarity summary
fields
cs.CV 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
WhACC: Whisker Automatic Contact Classifier with Expert Human-Level Performance
WhACC, a two-stage ResNet50V2 and LightGBM classifier with engineered temporal features, matches expert human whisker-touch labeling and reduces curation effort by over 98%.