Extends probing evaluation to acoustic teleportation codecs and reports that speaker identity stays partitioned while room acoustics leak into speech embeddings, with acoustic embeddings estimating room parameters nearly as well as supervised baselines.
Beyond Cross-Reconstruction: Probing-Based Disentanglement Evaluation for Acoustic Teleportation Codecs
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Some neural audio codecs disentangle speech into latent subspaces encoding content, speaker identity, and acoustics, enabling acoustic teleportation and voice conversion. Existing evaluations rely on cross-reconstruction quality, which cannot reliably detect leakage across partitions. We extend a probing based framework to assess disentanglement by regressing room-acoustic parameters (reverberation time, clarity, and direct-to-reverberant ratio) and classifying speaker identity, using the gap between intended and unintended partitions as the disentanglement measure. Applied to an acoustic teleportation codec, we find speaker identity is largely confined to its partition, while acoustics leak into the speech embeddings due to the training objective. Acoustic embeddings blindly estimate room parameters within 0.02 s of supervised baselines, indicating physically meaningful structure emerges without explicit supervision.
fields
eess.AS 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Beyond Cross-Reconstruction: Probing-Based Disentanglement Evaluation for Acoustic Teleportation Codecs
Extends probing evaluation to acoustic teleportation codecs and reports that speaker identity stays partitioned while room acoustics leak into speech embeddings, with acoustic embeddings estimating room parameters nearly as well as supervised baselines.