Audio Texture Manipulation by Exemplar-Based Analogy

Gopala Anumanchipalli; Kan Jen Cheng; Tingle Li

REVIEW 4 major objections 6 minor 40 references

Audio Texture Manipulation by Exemplar-Based Analogy

T0 review · 4 major / 6 minor · reviewed 2026-08-10 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper claims that a pair of before-and-after audio clips can define an edit—adding, removing, or replacing a sound texture—and that a latent diffusion model trained only on synthetic quadruplets learns to apply that same edit to any…

desk verdict A genuinely novel exemplar-based audio editing approach, but the evidence doesn't yet rule out class-conditional shortcutting via CLAP, so the central analogy claim hangs on untested assumptions. read the letter →

arxiv 2501.12385 v1 pith:OAWQM36R submitted 2025-01-21 cs.SD cs.LGeess.AS

Kan Jen Cheng , Tingle Li , Gopala Anumanchipalli This is my paper · ORCID

classification cs.SDcs.LGeess.AS

keywords audiotexturemanipulationexemplar-basedanalogylatentdiffusionmodelsself-supervisedlearningeditingsoundCLAPembeddingsspeechenhancement

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to establish that audio editing operations can be specified by example rather than by text. A model is given two exemplar clips—one before the edit and one after—and learns to apply the same transformation to a new input sound. If true, users could say 'make my recording sound like this pair' instead of struggling to describe edits in words, avoiding ambiguous prompts that cannot distinguish, say, removing a crow from removing all birds. The authors train a latent diffusion model self-supervised on synthetic quadruplets of speech plus ambient textures, and report that it outperforms a text-conditioned baseline and generalizes to non-speech and real-world audio.

What carries the argument

The load-bearing object is the self-supervised quadruplet $(a^1_e, a^2_e, a_q, a_o)$ together with the conditional latent diffusion model $F_\theta$. Training simulates edits by mixing ambient sounds from BBC SFX into clean speech from LibriSpeech and VCTK, so the model never sees a human label and must recover the operation from the exemplar pair alone. The exemplar pair is represented by CLAP embeddings with a learnable positional encoding to mark order, and classifier-free guidance sharpens the conditional output. A pretrained VAE and HiFi-GAN vocoder from AudioLDM encode and reconstruct mel-spectrograms, with the diffusion model operating in the compressed latent space.

What would settle it

Give the model an exemplar pair whose before-and-after change is only a texture (for instance, removing traffic noise from speech) but apply it to a query whose texture class was not seen in training, such as music, and objectively measure whether the target texture is removed; if the model fails on such out-of-domain content, the content-invariance claim is false.

Watch

Extended reading notes

Core claim

The central claim is that a function $F_\theta(a_q, a^1_e, a^2_e)$, trained solely on unlabeled quadruplets, learns to infer the transformation implied by an exemplar pair $(a^1_e, a^2_e)$ and apply it to a new input $a_q$. The exemplar pair is encoded with a CLAP audio encoder, marked with a learnable positional encoding to distinguish the 'before' from the 'after' clip, and fed into a latent diffusion model through cross-attention. At test time a completely different exemplar pair can be substituted, and the model tailors its output to that pair. The paper reports quantitative and perceptual results supporting this, including better performance than the text-conditioned AUDIT baseline on addition and removal tasks, and qualitative generalization to dog barking and CityWalk recordings.

Load-bearing premise

The load-bearing premise is that the transformation implied by an exemplar pair transfers to any new input regardless of content, so the model need not separate the texture change from the speech content of the exemplars.

Editorial extensions

If this is right

Users can specify edits such as 'remove only the crow, keep the sparrow' by supplying one before-and-after clip pair, without writing a text prompt.
The same training scheme covers three operation types—adding, removing, and replacing sound textures—so a single model handles multiple editing tasks.
Because the model is self-supervised on synthetic quadruplets, it avoids reliance on human annotations, which can be noisy or mislabeled.
The learnable positional encoding is necessary: without it the model cannot reliably tell which exemplar is 'before' and which is 'after', and performance drops.
Reported generalization to non-speech and real-world recordings suggests the learned operation is not tied to the synthetic training domain.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The method could be extended to learn from unlabeled internet audio by mining natural before-and-after pairs, such as a recording with and without a door closing, removing the need for synthetic mixing.
Because conditioning relies on CLAP embeddings, which align audio with language, the model may be limited to textures that have semantic labels; low-level or unnamed textures might not transfer as reliably.
A natural next test is whether the model truly extracts an operation from the exemplar pair or instead copies the exemplar output's texture onto the input; ablating with mismatched content in the pair would separate these possibilities.
Exemplar-based analogy could combine with text prompts, letting users refine an ambiguous instruction by demonstrating the intended edit.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Here's my take on arXiv:2501.12385. The paper has a fresh idea: specify audio texture edits with before/after exemplar pairs, learned via a self-supervised quadruplet task in a latent diffusion model. That's genuinely new, and the learnable positional encoding to disambiguate 'before' from 'after' is a nice touch. I also give them credit for running a 30-person perceptual study with confidence intervals and for openly reporting where they underperform MP-SENet on speech enhancement.

The soft spots are real. Table 1 reports objective metrics with no error bars or significance tests, so I can't tell if the differences over AUDIT are meaningful. AUDIT is re-implemented with no fidelity check. No code or data is released, and the vocoder processing for the main experiments isn't documented. Those are fixable reproducibility issues.

The larger concern is the one the stress-test raises: the model may be doing class-conditional texture transfer via CLAP embeddings rather than true exemplar analogy. Training textures all come from the BBC SFX inventory, and CLAP is pretrained on labeled sound events. So the model could solve the pretext task by reading the texture class from the exemplar embedding and applying that class to the input. All the positive evidence is consistent with that shortcut: Table I uses only BBC textures, Table III uses familiar urban sound types, and the non-speech claim rests on one qualitative example in Fig. 4. The paper's motivating case — remove the crow but keep the sparrow — is exactly what a class-conditional model cannot do, and it's never tested. So the central claim that the model learns a content-invariant transformation from the exemplar pair is unsupported by the current evidence.

That said, this is not a fatal incoherence. It's a load-bearing plausibility gap that better experiments can close: test with novel texture classes, test within-class distinctions, compare exemplar embeddings to actual transformation, release the code. The idea is good enough that I'd send it to peer review, but it needs a revision where the authors actively rule out the shortcut.

Referee Report

4 major / 6 minor

Summary. The paper proposes an exemplar-based audio texture manipulation model. Given a pair of exemplar audio clips (a1_e, a2_e) that define a transformation such as adding, removing, or replacing an ambient texture, the model Fθ(a_q, a1_e, a2_e) is trained with a latent diffusion model to apply the same transformation to a new input audio a_q. Training uses self-supervised quadruplets built from LibriSpeech/VCTK speech and BBC SFX ambient textures. The authors compare against a re-implemented AUDIT baseline and MP-SENet, evaluate with objective metrics (FAD, FD, KL, LSD, IS, PESQ, STOI) and a human rating study, and report ablations of a learnable positional encoding plus qualitative generalization to real-world and non-speech inputs.

Significance. If the central claim holds, the paper offers a text-free interface for audio editing and a self-supervised training scheme that avoids manual annotation. The method is clearly described, the architecture is sensible, and the human evaluation with confidence intervals is a strength, as is the honest limitations section. However, the current experimental design does not rule out a class-conditional shortcut in which the model reads only the texture label from the exemplar output, so the main 'analogy' claim and the out-of-distribution generalization claims need direct verification before the contribution is established.

major comments (4)

[II-A and III-A, Eq. (1)] The self-supervised task admits a shortcut: because the exemplar output a2_e and the target ao always contain the same ambient texture class, and because the condition is encoded with a fine-tuned CLAP encoder pretrained on labeled sound events, the model can minimize the denoising loss by extracting a texture-class embedding from E_a(a2_e) and applying it to z_q while ignoring E_a(a1_e). This would make Fθ a class-conditional texture editor rather than an exemplar-analogy model, and the claim in Section II-A that 'the model learns to tailor its output according to the transformation implied by the exemplar pair' would not be established. Please add (i) an ablation that conditions only on a2_e, (ii) a mismatch test where a1_e and a2_e are unrelated textures, and (iii) an evaluation on held-out texture classes not present in BBC SFX. If the model performs equally well without a1_e, the analogy framing should be revised.
[III-B, Table I] The objective results are reported without error bars, confidence intervals, or significance tests, and the pattern is not uniformly in the proposed model's favor (e.g., Addition 0→1 FAD is 5.58 for Ours vs 4.77 for AUDIT, while the +PE variant is 3.83; Replacement 1→1 FAD is 6.58 for Ours vs 4.94 for AUDIT). The statement in Section III-B that the model 'consistently outperforms AUDIT' in addition and removal is therefore stronger than the table supports. Please report standard errors or confidence intervals across seeds/test splits and state the number of evaluation samples.
[III-A (Baselines)] Because AUDIT is not open source, the comparison rests on a re-implementation, but the paper provides no fidelity check against the original model, such as reproducing AUDIT's published results on a standard prompt-based editing benchmark. If the re-implementation is much weaker than the original, the comparative claims in Tables I and III would be misleading. Please provide a sanity check, for example by comparing the re-implementation's performance on a public benchmark with the published numbers, or making the re-implementation available with evaluation code.
[III-E and Fig. 4] The claimed generalization to non-speech inputs is supported by a single qualitative example (dog barking), and the City Walk evaluation in Table III uses familiar sound types that overlap with the BBC SFX texture inventory. Since out-of-distribution robustness is one of the paper's headline claims, this evidence is thin. Please add a quantitative evaluation on non-speech inputs and/or on texture classes that were not seen during training, with objective metrics analogous to Table I.

minor comments (6)

[II-B] The sentence 'The model takes as input the encoded latent of the target audio, z0 = Enc(ao)' should clarify that this is the training target used to compute the loss in Eq. (1); at test time no target is available, so the wording is confusing.
[Eq. (1)] The expectation subscript 'Ez0,a1e,a2e,ϵ∼N (0,I),t' should specify the distribution of the timestep t and be typeset properly, e.g., E_{z0,a1_e,a2_e,ϵ∼N(0,I),t∼U{1,...,N}}.
[III-D] There is a typo 'PSEQ' (should be 'PESQ'), and the text should clarify whether the noisy and MP-SENet baselines in Table II were also processed through the HiFi-GAN vocoder so that the comparison is consistent.
[I] The motivating sparrow/crow example is not evaluated in the experiments; if it is meant to illustrate a capability, please connect it to the tested tasks or acknowledge that such fine-grained source separation is outside the current scope.
[Fig. 4] It would help to show the exemplar input as well as the exemplar output for the non-speech example, so the reader can verify the transformation direction.
[Table I] The 'Ours + PE' row is the full proposed model; the caption should state this explicitly and describe what 'Ours' (without PE) represents.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity; the central claim rests on constructed quadruplet supervision and external baselines, not on a fitted prediction or self-citation chain.

full rationale

The paper's derivation chain is not circular. The model is trained on quadruplets (exemplar input, exemplar output, new input, target output) that are automatically constructed by mixing BBC SFX ambient textures with LibriSpeech/VCTK speech, and the training loss (Eq. 1) directly supervises denoising toward the constructed target. The reported evaluations compare against external baselines (AUDIT, MP-SENet), objective metrics, and a subjective study on the CityWalk dataset. No prediction is produced by fitting a parameter to the same quantity that is later reported as a result; the hand-set guidance scale λ=4.5 affects generation quality but does not define the target output. The only self-citation is reference [12], which supplies the CityWalk evaluation data; it is not load-bearing for the core exemplar-analogy claim. The concern that the model might solve the task via CLAP semantic labels rather than true content-invariant transformation is a correctness-risk hypothesis, not a circularity: it does not make any equation or fitted value identical to the claimed result by construction. The paper itself acknowledges limitations such as the need for paired training data and sensitivity to ambiguous transformation direction, which further confirms that the claims are contingent on empirical behavior rather than definitional truth. Overall, no circular step meets the required evidentiary standard.

Assumptions & free parameters 6 free parameters · 4 assumptions · 0 invented entities

The central claim rests on the synthetic data construction and the pre-trained components; no new physical entities are introduced. The free parameters are standard hyperparameters, and the axioms are the domain assumptions needed for the self-supervised task to transfer to real-world audio.

free parameters (6)

guidance_scale_lambda = 4.5
Classifier-free guidance scale set by hand; affects the trade-off between diversity and quality and is used in all reported results.
diffusion_steps_N = 1000
Number of forward diffusion steps chosen for training.
ddim_sampling_steps = 200
Number of DDIM sampling steps at test time.
noise_schedule_beta = beta1=0.0015, betaN=0.0195
Linear noise schedule parameters.
compression_level_r = 4
VAE compression ratio from AudioLDM.
latent_channels_d = 8
VAE latent channels.

assumptions (4)

domain assumption Pre-trained AudioLDM VAE and HiFi-GAN vocoder faithfully encode and decode mel-spectrograms for speech and environmental sounds.
The entire pipeline relies on these pre-trained components without fine-tuning them; if the VAE latent space does not preserve texture information, the diffusion output cannot be faithful. (Sec. III-A Model configurations)
ad hoc to paper The synthetic quadruplet construction, where the same ambient sound is mixed into two different speech samples, defines a transformation that is independent of the speech content.
This is the core self-supervised premise; generalizing to new inputs and non-speech depends on the transformation being content-invariant. (Sec. II-A, Sec. III-A Training procedures)
domain assumption CLAP embeddings of the exemplar pair, after fine-tuning, capture the transformation direction rather than the specific speech content.
The exemplar pair is encoded with CLAP and fed via cross-attention; the model must extract the residual texture operation from the pair. (Sec. II-B Representing exemplar pair)
standard math Learning to predict noise in the latent diffusion objective with the given conditioning yields the intended semantic transformation.
Standard diffusion training objective; relies on the standard assumption that the conditional denoiser approximates the score. (Sec. II-B Eq. 1)

how reviews work

0 comments

Cite this review

Pith. "Pith review of Audio Texture Manipulation by Exemplar-Based Analogy." pith.science (2026). https://pith.science/paper/OAWQM36R

@misc{pith2026250112385,
  author       = {Pith},
  title        = {Pith review of: Audio Texture Manipulation by Exemplar-Based Analogy},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/OAWQM36R}},
  note         = {Machine review of arXiv:2501.12385}
}

read the original abstract

Audio texture manipulation involves modifying the perceptual characteristics of a sound to achieve specific transformations, such as adding, removing, or replacing auditory elements. In this paper, we propose an exemplar-based analogy model for audio texture manipulation. Instead of conditioning on text-based instructions, our method uses paired speech examples, where one clip represents the original sound and another illustrates the desired transformation. The model learns to apply the same transformation to new input, allowing for the manipulation of sound textures. We construct a quadruplet dataset representing various editing tasks, and train a latent diffusion model in a self-supervised manner. We show through quantitative evaluations and perceptual studies that our model outperforms text-conditioned baselines and generalizes to real-world, out-of-distribution, and non-speech scenarios. Project page: https://berkeley-speech-group.github.io/audio-texture-analogy/

Figures

Figures reproduced from arXiv: 2501.12385 by the authors.

**Figure 1.** Exemplar-based analogy for audio texture manipulation. We manipulate input speech (middle) based on an exemplar pair (left), where the pair defines the desired transformation such as adding, removing, or replacing specific sound elements. Inspired by these successes, we propose a model to audio texture manipulation via exemplar-based analogy. Our method leverages audio examples, rather than text instructions, to def… view at source ↗

**Figure 2.** Model architecture. Given the input audio and exemplar pair, our goal is to transform the input to match the texture transformation demonstrated by the exemplar pair. We employ a pre-trained VAE encoder to encode both the input and target spectrograms to the latent space, and feed them into a latent diffusion model together with the exemplar pair embedding and positional encoding. Finally, we use pre-trained VAE dec… view at source ↗

**Figure 3.** Model comparison. We present qualitative results between our model and AUDIT, where each input audio is transformed according to the exemplar pairs. Exemplar Output Remove Bird Exemplar Input Input Ours Target Add Street [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗

Figures from the paper (1 more)

**Figure 4.** Figure 4: Generalization to real-world data. Our model can generalize to non-speech (top) and real-world (bottom) scenarios. β1 = 0.0015 to βN = 0.0195 in the forward process. Moreover, we utilize the DDIM sampler [20] with 200 sampling steps for generating the output. We set th…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

40 extracted references · 16 canonical work pages

[1]

Sound texture perception via statistics of the auditory periphery: evidence from sound synthesis,

J. H. McDermott and E. P. Simoncelli, “Sound texture perception via statistics of the auditory periphery: evidence from sound synthesis,” Neuron, vol. 71, no. 5, pp. 926–940, 2011

work page 2011
[2]

Trends in audio texture analysis, synthesis, and applications,

G. Sharma, K. Umapathy, and S. Krishnan, “Trends in audio texture analysis, synthesis, and applications,” Journal of the Audio Engineering Society, vol. 70, no. 3, pp. 108–127, 2022

work page 2022
[3]

V oco: Text- based insertion and replacement in audio narration,

Z. Jin, G. J. Mysore, S. Diverdi, J. Lu, and A. Finkelstein, “V oco: Text- based insertion and replacement in audio narration,” ACM Transactions on Graphics (TOG) , vol. 36, no. 4, pp. 1–13, 2017

work page 2017
[4]

Audit: Audio editing by following instructions with latent diffusion models,

Y . Wang, Z. Ju, X. Tan, L. He, Z. Wu, J. Bian et al. , “Audit: Audio editing by following instructions with latent diffusion models,” Advances in Neural Information Processing Systems , vol. 36, pp. 71 340–71 357, 2023

work page 2023
[5]

Managing bias in human-annotated data: Moving beyond bias removal,

G. Demartini, K. Roitero, and S. Mizzaro, “Managing bias in human-annotated data: Moving beyond bias removal,” arXiv preprint arXiv:2110.13504, 2021

arXiv 2021
[6]

Bbc sound effects,

BBC Corporation, “Bbc sound effects,” 2017, available: https:// sound-effects.bbcrewind.co.uk/search

work page 2017
[7]

Skousen, Analogical modeling of language

R. Skousen, Analogical modeling of language . Springer Science & Business Media, 2012

work page 2012
[8]

Image analogies,

A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D. H. Salesin, “Image analogies,” in Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques . ACM, 2001, pp. 327– 340

work page 2001

Show all 40 references

[9]

Vi- sual prompting via image inpainting,

A. Bar, Y . Gandelsman, T. Darrell, A. Globerson, and A. Efros, “Vi- sual prompting via image inpainting,” Advances in Neural Information Processing Systems, vol. 35, pp. 25 005–25 017, 2022

2022
[10]

Sequential modeling enables scalable learning for large vision models,

Y . Bai, X. Geng, K. Mangalam, A. Bar, A. L. Yuille, T. Darrell, J. Malik, and A. A. Efros, “Sequential modeling enables scalable learning for large vision models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 22 861–22 872

2024
[11]

Conditional generation of audio from video via foley analogies,

Y . Du, Z. Chen, J. Salamon, B. Russell, and A. Owens, “Conditional generation of audio from video via foley analogies,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 2426–2436

2023
[12]

Self- supervised audio-visual soundscape stylization,

T. Li, R. Wang, P.-Y . Huang, A. Owens, and G. Anumanchipalli, “Self- supervised audio-visual soundscape stylization,” in Proceedings of the European Conference on Computer Vision , 2024

2024
[13]

Chain-of-thought prompting elicits reasoning in large language models,

J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V . Le, D. Zhou et al. , “Chain-of-thought prompting elicits reasoning in large language models,” Advances in neural information processing systems , vol. 35, pp. 24 824–24 837, 2022

2022
[14]

Automatic chain of thought prompting in large language models,

Z. Zhang, A. Zhang, M. Li, and A. Smola, “Automatic chain of thought prompting in large language models,” arXiv preprint arXiv:2210.03493 , 2022

2022 arXiv
[15]

Large language models as analogical reasoners,

M. Yasunaga, X. Chen, Y . Li, P. Pasupat, J. Leskovec, P. Liang, E. H. Chi, and D. Zhou, “Large language models as analogical reasoners,” arXiv preprint arXiv:2310.01714 , 2023

2023 arXiv
[16]

Librispeech: an asr corpus based on public domain audio books,

V . Panayotov, G. Chen, D. Povey, and S. Khudanpur, “Librispeech: an asr corpus based on public domain audio books,” in 2015 IEEE international conference on acoustics, speech and signal processing (ICASSP) . IEEE, 2015, pp. 5206–5210

2015
[17]

CSTR VCTK Corpus: English Multi-speaker Corpus for CSTR V oice Cloning Toolkit,

J. Yamagishi, C. Veaux, and K. MacDonald, “CSTR VCTK Corpus: English Multi-speaker Corpus for CSTR V oice Cloning Toolkit,” https: //doi.org/10.7488/ds/2645, 2019

2019 doi
[18]

High- resolution image synthesis with latent diffusion models,

R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High- resolution image synthesis with latent diffusion models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2022, pp. 10 684–10 695

2022
[19]

Denoising diffusion probabilistic models,

J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,” Advances in neural information processing systems , vol. 33, pp. 6840– 6851, 2020

2020
[20]

Denoising diffusion implicit models,

J. Song, C. Meng, and S. Ermon, “Denoising diffusion implicit models,” arXiv preprint arXiv:2010.02502 , 2020

2010 arXiv
[21]

Deep residual learning for image recognition,

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 770–778

2016
[22]

Auto-encoding variational bayes,

D. P. Kingma, “Auto-encoding variational bayes,” arXiv preprint arXiv:1312.6114, 2013

2013 arXiv
[23]

A scale for the measurement of the psychological magnitude pitch,

S. S. Stevens, J. V olkmann, and E. B. Newman, “A scale for the measurement of the psychological magnitude pitch,” The journal of the acoustical society of america , vol. 8, no. 3, pp. 185–190, 1937

1937
[24]

Audioldm: Text-to-audio generation with latent diffusion models,

H. Liu, Z. Chen, Y . Yuan, X. Mei, X. Liu, D. Mandic, W. Wang, and M. D. Plumbley, “Audioldm: Text-to-audio generation with latent diffusion models,” arXiv preprint arXiv:2301.12503 , 2023

2023 arXiv
[25]

Clap learning audio concepts from natural language supervision,

B. Elizalde, S. Deshmukh, M. Al Ismail, and H. Wang, “Clap learning audio concepts from natural language supervision,” in ICASSP 2023- 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5

2023
[26]

Attention is all you need,

A. Vaswani, “Attention is all you need,” Advances in Neural Information Processing Systems, 2017

2017
[27]

Bert: Pre-training of deep bidirectional transformers for language understanding,

J. Devlin, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805 , 2018

2018 arXiv
[28]

Classifier-free diffusion guidance,

J. Ho and T. Salimans, “Classifier-free diffusion guidance,” arXiv preprint arXiv:2207.12598, 2022

2022 arXiv
[29]

Hifi-gan: Generative adversarial networks for efficient and high fidelity speech synthesis,

J. Kong, J. Kim, and J. Bae, “Hifi-gan: Generative adversarial networks for efficient and high fidelity speech synthesis,” Advances in neural information processing systems , vol. 33, pp. 17 022–17 033, 2020

2020
[30]

Audiocaps: Generating captions for audios in the wild,

C. D. Kim, B. Kim, H. Lee, and G. Kim, “Audiocaps: Generating captions for audios in the wild,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, V olume 1 (Long and Short Papers),...

2019
[31]

Audio set: An ontology and human- labeled dataset for audio events,

J. F. Gemmeke, D. P. Ellis, D. Freedman, A. Jansen, W. Lawrence, R. C. Moore, M. Plakal, and M. Ritter, “Audio set: An ontology and human- labeled dataset for audio events,” in 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP) . IEEE, 2017,...

2017
[32]

Fsd50k: an open dataset of human-labeled sound events,

E. Fonseca, X. Favory, J. Pons, F. Font, and X. Serra, “Fsd50k: an open dataset of human-labeled sound events,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 30, pp. 829–852, 2021

2021
[33]

U-net: Convolutional networks for biomedical image segmentation,

O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international con- ference, Munich, Germany, October 5-9, 2015, proceedings, part III 18 ...

2015
[34]

Decoupled weight decay regularization,

I. Loshchilov, “Decoupled weight decay regularization,” arXiv preprint arXiv:1711.05101, 2017

2017 arXiv
[35]

Fr \’echet audio distance: A metric for evaluating music enhancement algorithms,

K. Kilgour, M. Zuluaga, D. Roblek, and M. Sharifi, “Fr \’echet audio distance: A metric for evaluating music enhancement algorithms,” arXiv preprint arXiv:1812.08466, 2018

2018 arXiv
[36]

On information and sufficiency,

S. Kullback and R. A. Leibler, “On information and sufficiency,” The annals of mathematical statistics , vol. 22, no. 1, pp. 79–86, 1951

1951
[37]

Per- ceptual evaluation of speech quality (pesq)-a new method for speech quality assessment of telephone networks and codecs,

A. W. Rix, J. G. Beerends, M. P. Hollier, and A. P. Hekstra, “Per- ceptual evaluation of speech quality (pesq)-a new method for speech quality assessment of telephone networks and codecs,” in 2001 IEEE international conference on acoustics, speech, and signal processing. Proce...

2001
[38]

A short- time objective intelligibility measure for time-frequency weighted noisy speech,

C. H. Taal, R. C. Hendriks, R. Heusdens, and J. Jensen, “A short- time objective intelligibility measure for time-frequency weighted noisy speech,” in 2010 IEEE international conference on acoustics, speech and signal processing . IEEE, 2010, pp. 4214–4217

2010
[39]

Mp-senet: A speech enhancement model with parallel denoising of magnitude and phase spectra,

Y .-X. Lu, Y . Ai, and Z.-H. Ling, “Mp-senet: A speech enhancement model with parallel denoising of magnitude and phase spectra,” arXiv preprint arXiv:2305.13686, 2023

2023 arXiv
[40]

Investi- gating rnn-based speech enhancement methods for noise-robust text-to- speech

C. Valentini-Botinhao, X. Wang, S. Takaki, and J. Yamagishi, “Investi- gating rnn-based speech enhancement methods for noise-robust text-to- speech.” in SSW, 2016, pp. 146–152

2016

Pith tools

Reviewed August 10, 2026 · model on record in the stance chip above.

[1] [1]

Sound texture perception via statistics of the auditory periphery: evidence from sound synthesis,

J. H. McDermott and E. P. Simoncelli, “Sound texture perception via statistics of the auditory periphery: evidence from sound synthesis,” Neuron, vol. 71, no. 5, pp. 926–940, 2011

work page 2011

[2] [2]

Trends in audio texture analysis, synthesis, and applications,

G. Sharma, K. Umapathy, and S. Krishnan, “Trends in audio texture analysis, synthesis, and applications,” Journal of the Audio Engineering Society, vol. 70, no. 3, pp. 108–127, 2022

work page 2022

[3] [3]

V oco: Text- based insertion and replacement in audio narration,

Z. Jin, G. J. Mysore, S. Diverdi, J. Lu, and A. Finkelstein, “V oco: Text- based insertion and replacement in audio narration,” ACM Transactions on Graphics (TOG) , vol. 36, no. 4, pp. 1–13, 2017

work page 2017

[4] [4]

Audit: Audio editing by following instructions with latent diffusion models,

Y . Wang, Z. Ju, X. Tan, L. He, Z. Wu, J. Bian et al. , “Audit: Audio editing by following instructions with latent diffusion models,” Advances in Neural Information Processing Systems , vol. 36, pp. 71 340–71 357, 2023

work page 2023

[5] [5]

Managing bias in human-annotated data: Moving beyond bias removal,

G. Demartini, K. Roitero, and S. Mizzaro, “Managing bias in human-annotated data: Moving beyond bias removal,” arXiv preprint arXiv:2110.13504, 2021

arXiv 2021

[6] [6]

Bbc sound effects,

BBC Corporation, “Bbc sound effects,” 2017, available: https:// sound-effects.bbcrewind.co.uk/search

work page 2017

[7] [7]

Skousen, Analogical modeling of language

R. Skousen, Analogical modeling of language . Springer Science & Business Media, 2012

work page 2012

[8] [8]

Image analogies,

A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D. H. Salesin, “Image analogies,” in Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques . ACM, 2001, pp. 327– 340

work page 2001