Language-based Audio Retrieval Task in DCASE 2022 Challenge

Huang Xie; Samuel Lipping; Tuomas Virtanen

Language-based Audio Retrieval Task in DCASE 2022 Challenge

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2209.09967 v3 pith:URLZYK6L submitted 2022-09-20 eess.AS cs.SD

Huang Xie , Samuel Lipping , Tuomas Virtanen This is my paper · ORCID

classification eess.AScs.SD

keywords audiosubtasksignalscaptionschallengedcaselanguage-basedretrieval

verification ladder T0 review T1 audit T2 compute T3 formal

0 comments

read the original abstract

Language-based audio retrieval is a task, where natural language textual captions are used as queries to retrieve audio signals from a dataset. It has been first introduced into DCASE 2022 Challenge as Subtask 6B of task 6, which aims at developing computational systems to model relationships between audio signals and free-form textual descriptions. Compared with audio captioning (Subtask 6A), which is about generating audio captions for audio signals, language-based audio retrieval (Subtask 6B) focuses on ranking audio signals according to their relevance to natural language textual captions. In DCASE 2022 Challenge, the provided baseline system for Subtask 6B was significantly outperformed, with top performance being 0.276 in mAP@10. This paper presents the outcome of Subtask 6B in terms of submitted systems' performance and analysis.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

Language-based Audio Retrieval with Co-Attention Networks
cs.SD 2024-12 conditional novelty 5.0 of 10

Cascaded co-attention between CLAP audio features and RoBERTa text features improves text-to-audio retrieval mAP by about 16 percent on Clotho and 15 percent on AudioCaps relative to the authors' earlier GPTtar method.

Pith tools