Pith. sign in

REVIEW 3 major objections 6 minor 42 cited by

IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speech

T0 review · 3 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read IndexTTS2 claims an autoregressive zero-shot TTS model can precisely control speech duration by specifying the semantic token count while independently controlling emotional style.

desk verdict A neat AR-TTS duration-control trick with broad experiments, but the duration claim is only verified in token-count, not seconds. read the letter →

arxiv 2506.21619 v2 pith:ZI73ZZXF submitted 2025-06-23 cs.CL cs.AIcs.SDeess.AS

Siyi Zhou , Yiquan Zhou , Yi He , Xun Zhou , Jinchao Wang , Wei Deng , Jingchen Shu This is my paper
classification cs.CLcs.AIcs.SDeess.AS
keywords IndexTTS2zero-shottext-to-speechdurationcontrolautoregressiveTTSemotionalspeechsynthesisspeaker-emotiondisentanglementflowmatchingtext-to-emotiondistillation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

IndexTTS2 sets out to show that autoregressive text-to-speech can have the naturalness of token-by-token generation and the controllability that previously favored non-autoregressive models. Its duration control works by telling the model exactly how many semantic speech units to emit, with the number of units tied to the model's own positional encoding so the generation stops at the requested length. Its emotion control works through a separate style-prompt embedding that is trained to carry emotional prosody but not speaker identity, plus a distilled text-to-emotion module that turns a natural-language instruction into an emotion vector. If the claims hold, the same system can dub a video at a specified timing, preserve a target speaker's timbre, and follow a user's emotional direction without sacrificing intelligibility.

What carries the argument

The load-bearing mechanism is the shared weight constraint between the duration embedding table and the semantic positional embedding table in the Text-to-Semantic module. The model receives $p = W_{num}h(T)$, a one-hot encoding of the requested token count mapped through an embedding table, and because this table is tied to the positional embeddings, the transformer can use position as a proxy for how many tokens remain; this is what lets an autoregressive model stop at exactly $T$ tokens rather than guessing an end point. Two supporting mechanisms carry the emotional claim: a gradient reversal layer that makes the emotion embedding adversarial to speaker classification, and a Semantic-to-Mel flow-matching module that fuses the T2S transformer's GPT hidden states into the semantic features to keep pronunciation clear in emotional speech. A third mechanism, the Text-to-Emotion module, distills a large language model's seven-emotion distribution predictions into a small student model and averages the corresponding emotion embeddings to produce the conditioning vector from natural language.

What would settle it

Run the duration-controlled mode on a set of utterances at 0.75x, 1x, and 1.25x target durations and compare the synthesized audio's actual length in seconds against the target movie-track length, across different speakers, emotions, and sentence lengths. If token counts are correct but the clock-time durations systematically miss the targets, the central duration-control claim fails even though token error rates look perfect.

Watch

Extended reading notes

Core claim

The paper's central claim is that duration and emotion can be controlled independently in an autoregressive zero-shot TTS pipeline without hurting naturalness, speaker similarity, or articulation. Duration control is exercised at generation time: the desired token count $T$ is turned into an embedding $p = W_{num}h(T)$, and because $W_{num}$ is tied to the semantic positional embedding table, the model learns to align its position information with the target length and to emit exactly the required sequence before the end-of-sequence token. Emotional control is exercised through a second conditioning stream, a Conformer-based emotion perceiver that extracts an emotion embedding from a style prompt; a gradient reversal layer and a speaker classifier push this embedding to be invariant to timbre, so the emotion of the style prompt transfers across speakers. The authors report that IndexTTS2 outperforms five zero-shot TTS baselines on word error rate, speaker similarity, and emotion similarity, and that it is the first autoregressive system to combine precise duration control with natural duration generation. They also report token-number error rates below 0.02% for original durations and subjectively higher prosody than non-autoregressive systems under fixed duration.

Load-bearing premise

The load-bearing premise is that the number of semantic tokens requested is a reliable proxy for audio duration in seconds; the paper measures token-count error rates but does not measure end-to-end alignment between synthesized audio length and target time.

Editorial extensions

If this is right

  • Zero-shot dubbing can specify duration as a token count and keep word error rates near baseline while scaling playback speed from 0.75x to 1.25x.
  • Speaker timbre and emotional tone can be chosen independently from two different prompt audios, following from the gradient-reversal-based disentanglement claim.
  • Natural-language emotional instructions can steer synthesis through a distilled seven-emotion distribution, outperforming instruction-based CosyVoice2 in subjective tests.
  • Autoregressive TTS under fixed duration can match the intelligibility of duration-controlled non-autoregressive models while retaining better prosody, as measured by SMOS, PMOS, and QMOS.
  • The duration-control scheme is claimed to transfer to any autoregressive large-scale TTS model, since it is a conditioning mechanism rather than an architecture-specific patch.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A direct testable extension of the duration claim is time-synchronous dubbing metrics: measure actual audio-length alignment in seconds rather than token-count error, since the paper stops short of that measurement.
  • If the gradient reversal layer truly makes the emotion embedding speaker-invariant, the same style prompt should transfer the same emotional prosody across many different timbre prompts; a systematic cross-speaker emotion-transfer benchmark would test this directly.
  • Because the Text-to-Emotion module is trained on only 1,000 text-distribution pairs across seven basic emotions, continuous emotion intensity and mixed-emotion prompts are plausible but untested next steps.
  • The claimed generality of the duration-control scheme suggests it could be grafted onto other autoregressive TTS models; reproducing the shared-positional-weight trick in another architecture would show whether the mechanism is truly model-agnostic.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. The paper proposes IndexTTS2, a cascaded autoregressive zero-shot text-to-speech system with three modules: a Text-to-Semantic (T2S) transformer, a flow-matching Semantic-to-Mel (S2M) module, and a BigVGANv2 vocoder. The main claimed contributions are (i) explicit token-count-based duration control in an autoregressive model alongside free-form natural-duration generation, (ii) disentanglement of emotional expression from speaker identity through a gradient reversal layer, (iii) a three-stage training strategy that improves emotional expressiveness and clarity, (iv) GPT-latent enhancement in the S2M module, and (v) a text-to-emotion (T2E) module distilled from Deepseek-r1 into Qwen-3-1.7b for natural-language emotional control. Experiments compare IndexTTS2 against MaskGCT, F5-TTS, CosyVoice2, SparkTTS, and IndexTTS on LibriSpeech, SeedTTS, AISHELL, and a newly recorded emotional test set, reporting objective measures (SS, WER, ES) and subjective MOS scores, plus a token-number-error-rate evaluation for duration control.

Significance. If the claims are fully supported, this is a practically important contribution: explicit duration control in an autoregressive zero-shot TTS would address a real bottleneck for dubbing and audio-visual synchronization, and the emotional disentanglement plus text-based emotion control would widen the usability of expressive TTS. The paper's strengths include large-scale training (55K hours), evaluation on multiple external benchmarks, a concrete architectural mechanism for duration conditioning via tied positional/duration embeddings, and a stated commitment to release code and weights. The GRL-based emotion/speaker disentanglement and the GPT-latent fusion for intelligibility under emotion are interesting and likely useful design ideas. However, the central duration-control evidence is currently incomplete, and several objective comparisons lack statistical support, so the significance of the headline results is not yet established.

major comments (3)
  1. [Duration-Specified Speech Synthesis Evaluation, Table 4] The paper's headline claim of precise duration control is evaluated only as token-number error rate, not as the duration of the synthesized audio in seconds. The T2S module produces a semantic token sequence of requested length T, but the S2M flow-matching module and BigVGANv2 convert those tokens into mel-spectrograms and a waveform, and nothing in the paper establishes a fixed mapping from token count to time. The training pipeline's random speed perturbation (scaling coefficients r1 and r2) makes it plausible that per-token acoustic duration varies across speakers, emotions, and speaking rates. The sentence 'these findings indicate an almost negligible gap between generated tokens and target durations' equates the intermediate representation with the final acoustic duration. Please report end-to-end duration error in seconds (e.g., mean absolute deviation of generated audio duration from the requested duration) on the same test sets, and provide the semantic codec's frame-rate and alignment characteristics to justify the token-to-time conversion.
  2. [Experiment Results, Tables 1 and 2] Objective metrics (SS, WER, ES) are reported as single point estimates with no error bars, confidence intervals, or significance tests, while subjective MOS intervals overlap for several key comparisons. For example, in Table 1 SeedTTS test-en, IndexTTS2's QMOS is 4.48±0.15 versus CosyVoice2's 4.52±0.15, and in the same table the full model's SS of 0.870 is below the ablated '-GPT latent' SS of 0.887. The abstract's claim of state-of-the-art performance across intelligibility, speaker similarity, and emotional fidelity is therefore not statistically supported as presented. Please add uncertainty quantification or significance testing for objective metrics, and state the number of raters and the rating protocol for the MOS evaluations.
  3. [Autoregressive Text-to-Semantic Module (T2S), Eq. (1)] The three-stage training procedure and the GRL-based loss are central to the emotional disentanglement claim, but the manuscript does not directly quantify how well speaker identity is removed from the emotion embedding e. The only evidence is the final emotional MOS/ES scores; there is no direct measurement of disentanglement, such as speaker-classification accuracy on e or emotion-classification accuracy on c. Please include such an analysis, or temper the disentanglement claim accordingly.
minor comments (6)
  1. [Related Work] The related-work paragraph on duration control contains a duplicated sentence: 'Methods like MaskGCT (Wang et al. 2024) use flow modeling for phoneme-level duration predictors based on diffusion...' appears twice with slightly different wording.
  2. [Baselines] There is a typo in the baseline list: 'CosyV ocie2' should be 'CosyVoice2'. Similarly, 'V ocoder' appears with an anomalous space in the method description.
  3. [Experimental Settings] The subjective evaluation section does not report the number of listeners, the number of judgments per item, or whether raters were screened for familiarity with the languages; please add these details for all MOS tables.
  4. [Table 1 and text around it] The observation that removing GPT latent enhancement 'consistently improves SS while degrading WER' but the full model receives higher subjective SMOS is presented without an explanation; a brief analysis of why objective speaker similarity and perceived similarity diverge would strengthen the discussion.
  5. [Footnote 1] The footnote on re-implemented published experiments is vague: 'minor performance variations... remain within acceptable ranges' does not specify which values changed, by how much, or whether the re-implemented baselines used identical decoding settings.
  6. [Figure 4] The WER comparison under duration control is shown without error bars or significance tests, so the claimed advantages over F5-TTS and MaskGCT are not statistically grounded.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: core claims are checked against external benchmarks and metrics; the token-count duration metric is a proxy validity gap, not a circular derivation, and self-citations are not load-bearing.

full rationale

The paper's central comparisons (WER, SS, ES, MOS) use external corpora (LibriSpeech, SeedTTS, AISHELL, ESD) and external feature extractors (Whisper, FunASR, emotion2vec), so the headline claims are not defined in terms of IndexTTS2's own outputs. The duration-control evaluation in Table 4 reports token-number error rate, i.e., whether the generated semantic-token sequence has the requested length T; this is a check of the model's ability to follow the T-conditioning p=Wnumh(T), not a measurement of audio duration in seconds. That is a missing validation of the seconds-level 'precise duration control' claim (a correctness risk), but it is not a circular step: the metric is an empirical model-behavior measurement rather than a quantity derived from the paper's assumptions. The self-citation to IndexTTS (Deng et al. 2025) for architecture and tokenizer is lineage, not load-bearing evidence for the new claims. The T2E module reuses the T2S emotion perceiver to build its embedding set, but the resulting emotional-control claim is evaluated with human MOS against CosyVoice2, so the loop is not closed by the paper's own metrics. No step in the derivation chain reduces by construction to its input.

Assumptions & free parameters 4 free parameters · 5 assumptions · 0 invented entities

The central claim rests on standard TTS pipeline assumptions plus the untested assumption that token count equals duration; no new physical entities are introduced.

free parameters (4)
  • Emotion loss coefficient alpha = not reported
    Weight of the speaker-classification adversarial term in Stage 2 loss (Eq. 1); chosen by hand, value not specified.
  • Emotion data subset size = 135 hours
    Curated emotional speech used in Stage 2; human selection decision.
  • Duration embedding zeroing probability = 0.3
    Stage 1 randomly sets p to zero with 30% probability; hand-chosen.
  • GPT latent fusion probability = 0.5
    S2M training randomly replaces semantic features with GPT latent features with 50% probability; hand-chosen.
assumptions (5)
  • domain assumption Semantic tokens from MaskGCT codec provide a sufficient representation for TTS synthesis.
    The entire T2S and S2M pipeline operates on these tokens without validating their adequacy.
  • standard math Flow matching ODE can map Gaussian noise to target mel-spectrograms conditioned on semantic and speaker features.
    Adopted from Lipman et al. 2023 and prior TTS systems; not re-derived.
  • domain assumption GRL training enforces emotion/speaker disentanglement.
    The paper assumes the adversarial classifier removes speaker identity from emotion features; no ablation isolates GRL.
  • domain assumption Deepseek-r1 provides accurate emotion probability distributions for text.
    Used as the teacher in Eq. 3; no human validation of the 1000 generated text-distribution pairs.
  • domain assumption Semantic token count is a proxy for speech duration.
    The duration control mechanism sets T as a target token count; the paper never maps token count to wall-clock duration.

how reviews work

0 comments
Cite this review

Pith. "Pith review of IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speech." pith.science (2026). https://pith.science/paper/ZI73ZZXF

@misc{pith2026250621619,
  author       = {Pith},
  title        = {Pith review of: IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speech},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/ZI73ZZXF}},
  note         = {Machine review of arXiv:2506.21619}
}
read the original abstract

Existing autoregressive large-scale text-to-speech (TTS) models have advantages in speech naturalness, but their token-by-token generation mechanism makes it difficult to precisely control the duration of synthesized speech. This becomes a significant limitation in applications requiring strict audio-visual synchronization, such as video dubbing. This paper introduces IndexTTS2, which proposes a novel, general, and autoregressive model-friendly method for speech duration control. The method supports two generation modes: one explicitly specifies the number of generated tokens to precisely control speech duration; the other freely generates speech in an autoregressive manner without specifying the number of tokens, while faithfully reproducing the prosodic features of the input prompt. Furthermore, IndexTTS2 achieves disentanglement between emotional expression and speaker identity, enabling independent control over timbre and emotion. In the zero-shot setting, the model can accurately reconstruct the target timbre (from the timbre prompt) while perfectly reproducing the specified emotional tone (from the style prompt). To enhance speech clarity in highly emotional expressions, we incorporate GPT latent representations and design a novel three-stage training paradigm to improve the stability of the generated speech. Additionally, to lower the barrier for emotional control, we designed a soft instruction mechanism based on text descriptions by fine-tuning Qwen3, effectively guiding the generation of speech with the desired emotional orientation. Finally, experimental results on multiple datasets show that IndexTTS2 outperforms state-of-the-art zero-shot TTS models in terms of word error rate, speaker similarity, and emotional fidelity. Audio samples are available at: https://index-tts.github.io/index-tts2.github.io/

Figures

Figures reproduced from arXiv: 2506.21619 by the authors.

Figure 1
Figure 1. The overview of IndexTTS2. mation during training. A multi-stage training strategy is adopted to overcome the lack of high-quality emotional data and enhance expressive capabilities. To enable natural lan￾guage emotion control in speech synthesis, we further de￾sign a Text-to-Emotion (T2E) module, distilling Deepseek￾r1’s (Guo et al. 2025) emotion distribution prediction ability into Qwen-3-1.7b (Yang et al. 2025) v… view at source ↗
Figure 2
Figure 2. Autoregressive Text-to-Semantic Module. When speech token num is specified, precise control of the number of [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Semantic-to-Mel module based on flow matching. [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: Comparison of WER for duration control section. [PITH_FULL_IMAGE:figures/full_fig_p007_4.png]

Discussion (0). Sign in to comment.

Forward citations

Cited by 42 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects

    cs.CL 2026-05 unverdicted novelty 7.0 of 10

    PolySpeech-100 is a new benchmark for native-level speech comprehension across 110 linguistic variants that evaluates 22 models and reports E2E advantages on dialects, robustness gaps on low-resource languages, and de...

  2. VITA-QinYu: Expressive Spoken Language Model for Role-Playing and Singing

    cs.CL 2026-05 unverdicted novelty 7.0 of 10

    VITA-QinYu is the first expressive end-to-end spoken language model supporting role-playing and singing alongside conversation, trained on 15.8K hours of data and outperforming prior models on expressiveness and conve...

  3. CoSyncDiT: Cognitive Synchronous Diffusion Transformer for Movie Dubbing

    cs.SD 2026-04 unverdicted novelty 7.0 of 10

    CoSyncDiT is a cognitive-inspired diffusion transformer that achieves state-of-the-art lip synchronization and naturalness in movie dubbing by guiding noise-to-speech generation through acoustic, visual, and contextua...

  4. CapTalk: Unified Voice Design for Single-Utterance and Dialogue Speech Generation

    cs.SD 2026-04 unverdicted novelty 7.0 of 10

    CapTalk unifies single-utterance and dialogue voice design via utterance- and speaker-level captions plus a hierarchical variational module for stable timbre with adaptive expression.

  5. JUST-DUB-IT: Video Dubbing via Joint Audio-Visual Diffusion

    cs.GR 2026-01 unverdicted novelty 7.0 of 10

    JUST-DUB-IT adapts a joint audio-visual diffusion model via LoRA to generate high-quality dubbed videos with translated audio and lip-synced facial motion.

  6. TED-TTS: Training-Free Intra-Utterance Emotion and Duration Control for Text-to-Speech Synthesis

    cs.SD 2026-01 unverdicted novelty 7.0 of 10

    A training-free framework for intra-utterance emotion and duration control in pretrained zero-shot TTS via segment-aware conditioning and steering strategies.

  7. Spoken Function Calling: A New Perspective on Spoken Language Understanding for Large Audio Language Models

    cs.CL 2026-08 conditional novelty 6.0 of 10

    Structuring spoken language understanding as function calling improves semantic extraction accuracy over traditional intent-and-slot formats for both text and audio models.

  8. SwanTale: Unified Multi-Speaker Speech and Audio Generation for Instruct and Zero-Shot Tasks

    eess.AS 2026-08 conditional novelty 6.0 of 10

    SwanTale unifies instruction-driven and zero-shot speech and audio generation in one 48 kHz model, with a large captioning pipeline, and reports leading scores on several expressiveness and instruction-following benchmarks.

  9. UniSAE: Unified Speech Attribute Editing on Speaker, Emotion and Low-Level Content via Discrete Phonetic Posteriorgram Modelling

    cs.SD 2026-06 unverdicted novelty 6.0 of 10

    UniSAE unifies speaker, emotion, and multi-granularity content editing in speech via a new discrete phonetic posteriorgram representation and diffusion-based rendering.

  10. How to Leverage Synthetic Speech for LLM-Based ASR Systems?

    cs.CL 2026-06 conditional novelty 6.0 of 10

    Layer-wise pooling plus RIR-augmented synthetic speech matches a 100%-real ASR baseline with only 25% real data (13.6 h) and beats it at higher real fractions.

  11. FlowTTS-GRPO: Online Reinforcement Learning with Multi-Objective Reward Optimization for Flow-Matching Based Text-to-Speech

    eess.AS 2026-06 conditional novelty 6.0 of 10

    FlowTTS-GRPO fine-tunes open-source flow-matching TTS models with multi-objective online RL via ODE-to-SDE conversion, improving speaker similarity and quality on CosyVoice 3.0 and F5-TTS.

  12. DLLM-TTS: Block Discrete Diffusion Language Model for Text-to-Speech Synthesis

    cs.CL 2026-06 conditional novelty 6.0 of 10

    Block discrete diffusion over X-Codec2 tokens yields competitive zero-shot TTS with 0.6B parameters, 20K training hours, and a 0.15 real-time factor.

  13. An Evaluation Framework for Text-to-Speech Voice Reconstruction

    eess.AS 2026-06 unverdicted novelty 6.0 of 10

    The paper introduces a subjective-objective evaluation framework using Best Worst Scaling and a novel dual-reference distributional measure to better assess intelligibility versus speaker identity trade-offs in TTS vo...

  14. Joycent: Diffusion-based Accent TTS without Accented Phone Prediction

    cs.SD 2026-06 unverdicted novelty 6.0 of 10

    Joycent uses diffusion modeling and conditional layer normalization to synthesize accented speech from standard phones and references, claiming better accentedness and speaker preservation than two-stage baselines.

  15. EmoInstruct-TTS: Dual-Path Instruction-Guided Emotional Speech Synthesis

    cs.CL 2026-06 unverdicted novelty 6.0 of 10

    EmoInstruct-TTS uses Emotion2embed and an Instruction-Conditioned Emotion Flow Model (ICE-Flow) to generate acoustically grounded emotion representations from free-form instructions and integrate them into an LLM-base...

  16. TLDR: Compressing Audio Tokens for Efficient Autoregressive Text-to-Speech

    cs.SD 2026-06 unverdicted novelty 6.0 of 10

    TLDR groups codec tokens into patches for patch-level autoregressive modeling in pretrained TTS systems, yielding 1.8x speedup and 75% KV-cache reduction at patch size 4.

  17. UniVocal: Unified Speech-Singing Code-Switching Synthesis

    cs.SD 2026-06 unverdicted novelty 6.0 of 10

    UniVocal presents a text-context-only framework for speech-singing code-switching synthesis via two-stage curriculum learning and a synthetic data pipeline, claiming SOTA on a new benchmark.

  18. SwanVoice: Expressive Long-Form Zero-Shot Speech Synthesis for Both Monologue and Dialogue

    eess.AS 2026-05 unverdicted novelty 6.0 of 10

    SwanVoice is a zero-shot TTS system for 1-4 speakers that reports higher richness and hierarchy scores than open-source baselines on monologue and dialogue tasks via mixed training and DiffusionNFT post-training.

  19. RobustSpeechFlow: Learning Robust Text-to-Speech Trajectories via Augmentation-based Contrastive Flow Matching

    cs.SD 2026-05 unverdicted novelty 6.0 of 10

    RobustSpeechFlow improves TTS alignment robustness by extending contrastive flow matching with length-preserving repeat and skip latent augmentations, lowering WER from 1.44 to 1.38 on Seed-TTS-eval and CER on ZERO500.

  20. RobustSpeechFlow: Learning Robust Text-to-Speech Trajectories via Augmentation-based Contrastive Flow Matching

    cs.SD 2026-05 conditional novelty 6.0 of 10

    By training flow-matching TTS to avoid augmented repeat/skip latent trajectories, RobustSpeechFlow cuts Seed-TTS-eval WER from 1.44 to 1.38 and improves CER on a new multilingual benchmark.

  21. From Flat Language Labels to Typological Priors: Structured Language Conditioning for Multilingual Speech-to-Speech Translation

    cs.CL 2026-05 unverdicted novelty 6.0 of 10

    S2ST-Omni 2 uses typology-informed hierarchical encoding, gated Dual-CTC, and typology-aware prompting to improve multilingual S2ST over flat-label baselines on CVSS-C, with gains in low-data regimes.

  22. AuDirector: A Self-Reflective Closed-Loop Framework for Immersive Audio Storytelling

    cs.SD 2026-05 unverdicted novelty 6.0 of 10

    AuDirector is a self-reflective closed-loop multi-agent framework that generates immersive audio narratives with improved structural coherence, emotional expressiveness, and acoustic fidelity via identity-aware voice ...

  23. The False Resonance: A Critical Examination of Emotion Embedding Similarity for Speech Generation Evaluation

    eess.AS 2026-04 unverdicted novelty 6.0 of 10

    Emotion embedding similarities are unsuitable for zero-shot evaluation of emotional expressiveness in speech generation due to confounding by non-emotional acoustic features.

  24. The False Resonance: A Critical Examination of Emotion Embedding Similarity for Speech Generation Evaluation

    eess.AS 2026-04 conditional novelty 6.0 of 10

    Emotion-embedding cosine similarity (EMO-SIM) fails to track emotion under speaker or wording changes and misaligns with human perception, so it is unreliable for evaluating expressive speech generation.

  25. RTCFake: Speech Deepfake Detection in Real-Time Communication

    cs.SD 2026-04 unverdicted novelty 6.0 of 10

    RTCFake is the first large-scale dataset of real-time communication speech deepfakes paired with offline versions, paired with a phoneme-guided consistency learning method that improves cross-platform and noise-robust...

  26. TTS-PRISM: A Perceptual Reasoning and Interpretable Speech Model for Fine-Grained Diagnosis

    cs.CL 2026-04 unverdicted novelty 6.0 of 10

    TTS-PRISM defines a 12-dimensional perceptual schema, builds a targeted diagnostic dataset via adversarial synthesis and expert labels, and tunes an end-to-end model that outperforms generalist LLMs in human alignment...

  27. MoVE: Translating Laughter and Tears via Mixture of Vocalization Experts in Speech-to-Speech Translation

    cs.CL 2026-04 unverdicted novelty 6.0 of 10

    MoVE uses specialized LoRA expert adapters and a soft router to translate non-verbal vocalizations in S2ST, reproducing them in 76% of cases versus at most 14% for baselines while scoring highest on naturalness and em...

  28. FastTurn: Unifying Acoustic and Streaming Semantic Cues for Low-Latency and Robust Turn Detection

    cs.SD 2026-04 unverdicted novelty 6.0 of 10

    FastTurn unifies acoustic features and streaming CTC decoding for low-latency, robust turn detection in full-duplex dialogue systems and releases a realistic human-dialogue test set.

  29. DeepSlide: From Artifacts to Presentation Delivery

    cs.AI 2026-04 unverdicted novelty 6.0 of 10

    DeepSlide introduces a multi-agent system for full presentation preparation that matches baselines on slide quality but improves narrative flow, pacing, and script synergy via a new dual-scoreboard benchmark.

  30. OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models

    cs.CL 2026-04 unverdicted novelty 6.0 of 10

    OmniVoice introduces a diffusion language model-style non-autoregressive TTS system that directly maps text to multi-codebook acoustic tokens, scaling zero-shot synthesis to over 600 languages with SOTA results on mul...

  31. Enroll-on-Wakeup: A First Comparative Study of Target Speech Extraction for Seamless Interaction in Real Noisy Human-Machine Dialogue Scenarios

    eess.AS 2026-02 conditional novelty 6.0 of 10

    Using the wake-up word as enrollment degrades current target-speech-extraction models; TTS cleanup improves perceived quality but not ASR accuracy.

  32. How to Leverage Synthetic Speech for LLM-Based ASR Systems?

    cs.CL 2026-06 unverdicted novelty 5.0 of 10

    Layer selection plus RIR augmentation on synthetic speech matches full real-data ASR performance using 25% real speech in SLAM-ASR.

  33. FlowTTS-GRPO: Online Reinforcement Learning with Multi-Objective Reward Optimization for Flow-Matching Based Text-to-Speech

    eess.AS 2026-06 unverdicted novelty 5.0 of 10

    FlowTTS-GRPO applies online RL with weighted multi-objective rewards to flow-matching TTS models via ODE-to-SDE conversion, reporting gains in speaker similarity and perceptual quality on CosyVoice 3.0 and F5-TTS.

  34. Resonant Minds: Closed-Loop Social Avatars with Theory of Mind

    cs.CV 2026-06 unverdicted novelty 5.0 of 10

    A dual-agent closed-loop system integrates Theory of Mind reasoning with multimodal video generation to create social avatars that outperform full-information baselines on dialogue quality under information asymmetry.

  35. DUET: Unified Dual-Space Emotion Control for Diffusion and Flow-Matching Driven Text-to-Speech

    cs.SD 2026-05 unverdicted novelty 5.0 of 10

    DUET enables fine-grained emotion control in pretrained diffusion and flow-matching TTS models via unified hidden-space steering and mel-space guidance, outperforming supervised baselines on multiple backbones.

  36. AgentSteerTTS: A Multi-Agent Closed-Loop Framework for Composite-Instruction Text-to-Speech

    cs.CV 2026-05 unverdicted novelty 5.0 of 10

    AgentSteerTTS proposes a multi-agent framework with adversarial disentanglement, dual-stream anchoring via acoustic prototypes, and fast-slow feedback to achieve intent-faithful expressive TTS for composite instructions.

  37. AuDirector: A Self-Reflective Closed-Loop Framework for Immersive Audio Storytelling

    cs.SD 2026-05 unverdicted novelty 5.0 of 10

    AuDirector proposes a self-reflective closed-loop multi-agent framework with identity-aware pre-production, collaborative synthesis-correction, and human-guided refinement for coherent immersive audio storytelling.

  38. FastTurn: Unifying Acoustic and Streaming Semantic Cues for Low-Latency and Robust Turn Detection

    cs.SD 2026-04 unverdicted novelty 5.0 of 10

    FastTurn fuses streaming CTC semantics with acoustic cues for lower-latency, more accurate turn detection and ships a real-dialogue test set.

  39. FastTurn: Unifying Acoustic and Streaming Semantic Cues for Low-Latency and Robust Turn Detection

    cs.SD 2026-04 unverdicted novelty 5.0 of 10

    FastTurn fuses streaming CTC semantics with acoustic cues for lower-latency, more accurate turn detection in full-duplex dialogue and releases a real-dialogue test set.

  40. Sharp spectral estimates for free boundary problems arising in plasma physics

    math.AP 2026-04 unverdicted novelty 5.0 of 10

    For a constrained superlinear free-boundary plasma model, the non-local first eigenvalue σ₁ is always positive on balls in every dimension N≥2, despite lacking a general Faber–Krahn property.

  41. SARA: A Dual-Stream VAE for High-Fidelity Speech Generation via Integrating Semantic and Acoustic Representations

    cs.SD 2026-06 unverdicted novelty 4.0 of 10

    SARA is a dual-stream VAE that integrates semantic and acoustic streams to achieve high-fidelity reconstruction and natural zero-shot TTS without complex regularizers.

  42. Beyond Semantic Dominance: Cognitive Affective Reasoning and Empathetic Response Alignment in Audio Language Models

    eess.AS 2026-06 unverdicted novelty 4.0 of 10

    CogAudio-LLM introduces LIME-440K dataset, EIPS chain-of-thought reasoning, and DR-SAPO optimization to address semantic dominance and improve affective responses in audio language models.

Reference graph

Works this paper leans on

61 extracted references · 33 canonical work pages · cited by 35 Pith papers

  1. [1]

    Anastassiou, P.; Chen, J.; Chen, J.; Chen, Y.; Chen, Z.; Chen, Z.; Cong, J.; Deng, L.; Ding, C.; Gao, L.; et al. 2024. Seed-tts: A family of high-quality versatile speech generation models. arXiv preprint arXiv:2406.02430

    arXiv 2024

  2. [2]

    C.; Vidler, J.; and Roedig, U

    Bor, M. C.; Vidler, J.; and Roedig, U. 2016. LoRa for the Internet of Things. In Ewsn, volume 16, 361--366

    work page 2016

  3. [3]

    Bu, H.; Du, J.; Na, X.; Wu, B.; and Zheng, H. 2017. Aishell-1: An open-source mandarin speech corpus and a speech recognition baseline. In 2017 20th conference of the oriental chapter of the international coordinating committee on speech databases and speech I/O systems and assessment (O-COCOSDA), 1--5. IEEE

    work page 2017

  4. [4]

    o lge, E.; G \

    Casanova, E.; Davis, K.; G \"o lge, E.; G \"o knar, G.; Gulea, I.; Hart, L.; Aljafari, A.; Meyer, J.; Morais, R.; Olayemi, S.; et al. 2024. XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model. CoRR

    work page 2024

  5. [5]

    T.; Rubanova, Y.; Bettencourt, J.; and Duvenaud, D

    Chen, R. T.; Rubanova, Y.; Bettencourt, J.; and Duvenaud, D. K. 2018. Neural ordinary differential equations. Advances in neural information processing systems, 31

    work page 2018

  6. [6]

    Chen, S.; Feng, Y.; He, L.; He, T.; He, W.; Hu, Y.; Lin, B.; Lin, Y.; Pan, Y.; Tan, P.; et al. 2024 a . Takin: A cohort of superior quality zero-shot speech generation models. arXiv preprint arXiv:2409.12139

    arXiv 2024

  7. [7]

    Chen, W.; Yang, S.; Li, G.; and Wu, X. 2025. DrawSpeech: Expressive Speech Synthesis Using Prosodic Sketches as Control Conditions. In ICASSP 2025-2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1--5. IEEE

    work page 2025

  8. [8]

    Chen, Y.; Niu, Z.; Ma, Z.; Deng, K.; Wang, C.; Zhao, J.; Yu, K.; and Chen, X. 2024 b . F5-tts: A fairytaler that fakes fluent and faithful speech with flow matching. arXiv preprint arXiv:2410.06885

    arXiv 2024

Show all 61 references
  1. [9]

    Cho, D.-H.; Oh, H.-S.; Kim, S.-B.; and Lee, S.-W. 2025. EmoSphere++: Emotion-controllable zero-shot text-to-speech via emotion-adaptive spherical vector. IEEE Transactions on Affective Computing

    2025

  2. [10]

    Cong, G.; Pan, J.; Li, L.; Qi, Y.; Peng, Y.; van den Hengel, A.; Yang, J.; and Huang, Q. 2025. Emodubber: Towards high quality and emotion controllable movie dubbing. In Proceedings of the Computer Vision and Pattern Recognition Conference, 15863--15873

    2025

  3. [11]

    Deng, W.; Zhou, S.; Shu, J.; Wang, J.; and Wang, L. 2025. IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System. arXiv preprint arXiv:2502.05512

    2025 arXiv

  4. [12]

    Devalal, S.; and Karthikeyan, A. 2018. LoRa technology-an overview. In 2018 second international conference on electronics, communication and aerospace technology (ICECA), 284--290. IEEE

    2018

  5. [13]

    Du, Z.; Chen, Q.; Zhang, S.; Hu, K.; Lu, H.; Yang, Y.; Hu, H.; Zheng, S.; Gu, Y.; Ma, Z.; et al. 2024 a . Cosyvoice: A scalable multilingual zero-shot text-to-speech synthesizer based on supervised semantic tokens. arXiv preprint arXiv:2407.05407

    2024 arXiv

  6. [14]

    Du, Z.; Wang, Y.; Chen, Q.; Shi, X.; Lv, X.; Zhao, T.; Gao, Z.; Yang, Y.; Gao, C.; Wang, H.; et al. 2024 b . Cosyvoice 2: Scalable streaming speech synthesis with large language models. arXiv preprint arXiv:2412.10117

    2024 arXiv

  7. [15]

    A.; and Wang, H

    Elizalde, B.; Deshmukh, S.; Ismail, M. A.; and Wang, H. 2023. CLAP Learning Audio Concepts from Natural Language Supervision. In IEEE International Conference on Acoustics, Speech and Signal Processing ICASSP 2023, Rhodes Island, Greece, June 4-10, 2023 , 1--5. IEEE

    2023

  8. [16]

    E.; Wang, X.; Thakker, M.; Li, C.; Tsai, C.; Xiao, Z.; Yang, H.; Zhu, Z.; Tang, M.; Tan, X.; Liu, Y.; Zhao, S.; and Kanda, N

    Eskimez, S. E.; Wang, X.; Thakker, M.; Li, C.; Tsai, C.; Xiao, Z.; Yang, H.; Zhu, Z.; Tang, M.; Tan, X.; Liu, Y.; Zhao, S.; and Kanda, N. 2024. E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS . In IEEE Spoken Language Technology Workshop, SLT 2024, Macao, De...

    2024

  9. [17]

    Ganin, Y.; Ustinova, E.; Ajakan, H.; Germain, P.; Larochelle, H.; Laviolette, F.; March, M.; and Lempitsky, V. 2016. Domain-adversarial training of neural networks. Journal of machine learning research, 17(59): 1--35

    2016

  10. [18]

    Gao, Z.; Li, Z.; Wang, J.; Luo, H.; Shi, X.; Chen, M.; Li, Y.; Zuo, L.; Du, Z.; and Zhang, S. 2023. FunASR: A Fundamental End-to-End Speech Recognition Toolkit. In 24th Annual Conference of the International Speech Communication Association, Interspeech 2023, Dublin, Ireland, ...

    2023

  11. [19]

    Guo, D.; Yang, D.; Zhang, H.; Song, J.; Zhang, R.; Xu, R.; Zhu, Q.; Ma, S.; Wang, P.; Bi, X.; et al. 2025. Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948

    2025 arXiv

  12. [20]

    Guo, H.-H.; Hu, Y.; Liu, K.; Shen, F.-Y.; Tang, X.; Wu, Y.-C.; Xie, F.-L.; Xie, K.; and Xu, K.-T. 2024. Fireredtts: A foundation text-to-speech framework for industry-level generative speech applications. arXiv preprint arXiv:2409.03283

    2024 arXiv

  13. [21]

    Guo, T.; Wen, C.; Jiang, D.; Luo, N.; Zhang, R.; Zhao, S.; Li, W.; Gong, C.; Zou, W.; Han, K.; et al. 2021. Didispeech: A large scale mandarin speech corpus. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 6968--6972. IEEE

    2021

  14. [22]

    He, H.; Shang, Z.; Wang, C.; Li, X.; Gu, Y.; Hua, H.; Liu, L.; Yang, C.; Li, J.; Shi, P.; et al. 2024. Emilia: An extensive, multilingual, and diverse speech dataset for large-scale speech generation. In 2024 IEEE Spoken Language Technology Workshop (SLT), 885--890. IEEE

    2024

  15. [23]

    Ji, S.; Zuo, J.; Wang, W.; Fang, M.; Zheng, S.; Chen, Q.; Jiang, Z.; Huang, H.; Wang, Z.; Cheng, X.; et al. 2024. Controlspeech: Towards simultaneous zero-shot speaker cloning and zero-shot language style control with decoupled codec. arXiv preprint arXiv:2406.01205

    2024 arXiv

  16. [24]

    Ju, Z.; Wang, Y.; Shen, K.; Tan, X.; Xin, D.; Yang, D.; Liu, Y.; Leng, Y.; Song, K.; Tang, S.; Wu, Z.; Qin, T.; Li, X.-Y.; Ye, W.; Zhang, S.; Bian, J.; He, L.; Li, J.; and Zhao, S. 2024. NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models. ar...

    2024 arXiv

  17. [25]

    Kim, D.; Hong, S.; and Choi, Y.-H. 2023. SC VALL-E: Style-Controllable Zero-Shot Text to Speech Synthesizer. arXiv preprint arXiv:2307.10550

    2023 arXiv

  18. [26]

    Kim, J.; Kim, S.; Kong, J.; and Yoon, S. 2020. Glow-tts: A generative flow for text-to-speech via monotonic alignment search. Advances in Neural Information Processing Systems, 33: 8067--8077

    2020

  19. [27]

    Koenker, R.; and Bassett Jr, G. 1978. Regression quantiles. Econometrica: journal of the Econometric Society, 33--50

    1978

  20. [28]

    Le, M.; Vyas, A.; Shi, B.; Karrer, B.; Sari, L.; Moritz, R.; Williamson, M.; Manohar, V.; Adi, Y.; Mahadeokar, J.; et al. 2023. Voicebox: Text-guided multilingual universal speech generation at scale. Advances in neural information processing systems, 36: 14005--14034

    2023

  21. [29]

    W.; Kim, J.; and Cho, J

    Lee, K.; Kim, D. W.; Kim, J.; and Cho, J. 2024. Ditto-tts: Efficient and scalable zero-shot text-to-speech with diffusion transformer. arXiv preprint arXiv:2406.11427

    2024 arXiv

  22. [30]

    Lee, S.; Ping, W.; Ginsburg, B.; Catanzaro, B.; and Yoon, S. 2023. BigVGAN: A Universal Neural Vocoder with Large-Scale Training. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023

    2023

  23. [31]

    Li, H.; Li, Y.; Wang, X.; Hu, J.; Xie, Q.; Yang, S.; and Xie, L. 2025. FleSpeech: Flexibly Controllable Speech Generation with Various Prompts. arXiv preprint arXiv:2501.04644

    2025 arXiv

  24. [32]

    A.; Han, C.; Raghavan, V.; Mischler, G.; and Mesgarani, N

    Li, Y. A.; Han, C.; Raghavan, V.; Mischler, G.; and Mesgarani, N. 2023. Styletts 2: Towards human-level text-to-speech through style diffusion and adversarial training with large speech language models. Advances in Neural Information Processing Systems, 36: 19594--19621

    2023

  25. [33]

    Lipman, Y.; Chen, R. T. Q.; Ben - Hamu, H.; Nickel, M.; and Le, M. 2023. Flow Matching for Generative Modeling. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023

    2023

  26. [34]

    Liu, S. 2024. Zero-shot Voice Conversion with Diffusion Transformers. arXiv preprint arXiv:2411.09943

    2024 arXiv

  27. [35]

    Ma, Z.; Zheng, Z.; Ye, J.; Li, J.; Gao, Z.; Zhang, S.; and Chen, X. 2024. emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation. In Ku, L.; Martins, A.; and Srikumar, V., eds., Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, ...

    2024

  28. [36]

    Mentzer, F.; Minnen, D.; Agustsson, E.; and Tschannen, M. 2023. Finite scalar quantization: Vq-vae made simple. arXiv preprint arXiv:2309.15505

    2023 arXiv

  29. [37]

    Panayotov, V.; Chen, G.; Povey, D.; and Khudanpur, S. 2015. Librispeech: an asr corpus based on public domain audio books. In 2015 IEEE international conference on acoustics, speech and signal processing (ICASSP), 5206--5210. IEEE

    2015

  30. [38]

    Peebles, W.; and Xie, S. 2023. Scalable diffusion models with transformers. In Proceedings of the IEEE/CVF international conference on computer vision, 4195--4205

    2023

  31. [39]

    Qi, T.; Zheng, W.; Lu, C.; Zong, Y.; and Lian, H. 2024. PAVITS: Exploring Prosody-Aware VITS for End-to-End Emotional Voice Conversion. In IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2024, Seoul, Republic of Korea, April 14-19, 2024 , 12697...

    2024

  32. [40]

    W.; Hallacy, C.; Ramesh, A.; Goh, G.; Agarwal, S.; Sastry, G.; Askell, A.; Mishkin, P.; Clark, J.; Krueger, G.; and Sutskever, I

    Radford, A.; Kim, J. W.; Hallacy, C.; Ramesh, A.; Goh, G.; Agarwal, S.; Sastry, G.; Askell, A.; Mishkin, P.; Clark, J.; Krueger, G.; and Sutskever, I. 2021. Learning Transferable Visual Models From Natural Language Supervision. In Meila, M.; and Zhang, T., eds., Proceedings of...

    2021

  33. [41]

    W.; Xu, T.; Brockman, G.; McLeavey, C.; and Sutskever, I

    Radford, A.; Kim, J. W.; Xu, T.; Brockman, G.; McLeavey, C.; and Sutskever, I. 2023. Robust speech recognition via large-scale weak supervision. In International conference on machine learning, 28492--28518. PMLR

    2023

  34. [42]

    Ren, Y.; Hu, C.; Tan, X.; Qin, T.; Zhao, S.; Zhao, Z.; and Liu, T.-Y. 2022. FastSpeech 2: Fast and High-Quality End-to-End Text to Speech

    2022

  35. [43]

    A.; Gonzalez, J.; and Escalera, S

    Rodr \' guez, P.; Bautista, M. A.; Gonzalez, J.; and Escalera, S. 2018. Beyond one-hot encoding: Lower dimensional target embedding. Image and Vision Computing, 75: 21--31

    2018

  36. [44]

    Rosenblatt, F. 1958. The perceptron: a probabilistic model for information storage and organization in the brain. Psychological review, 65(6): 386

    1958

  37. [45]

    E.; Hinton, G

    Rumelhart, D. E.; Hinton, G. E.; and Williams, R. J. 1986. Learning representations by back-propagating errors. nature, 323(6088): 533--536

    1986

  38. [46]

    Sahipjohn, N.; Gudmalwar, A.; Shah, N.; Wasnik, P.; and Shah, R. R. 2024. DubWise: Video-guided speech duration control in multimodal LLM-based text-to-speech for dubbing. arXiv preprint arXiv:2406.08802

    2024 arXiv

  39. [47]

    Shen, K.; Ju, Z.; Tan, X.; Liu, E.; Leng, Y.; He, L.; Qin, T.; Zhao, S.; and Bian, J. 2024. NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers. In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienn...

    2024

  40. [48]

    Sundaram, J. P. S.; Du, W.; and Zhao, Z. 2019. A survey on LoRa networking: Research problems, current solutions, and open issues. IEEE Communications Surveys & Tutorials, 22(1): 371--388

    2019

  41. [49]

    Touvron, H.; Lavril, T.; Izacard, G.; Martinet, X.; Lachaux, M.; Lacroix, T.; Rozi \` e re, B.; Goyal, N.; Hambro, E.; Azhar, F.; Rodriguez, A.; Joulin, A.; Grave, E.; and Lample, G. 2023. LLaMA: Open and Efficient Foundation Language Models. CoRR, abs/2302.13971

    2023 arXiv

  42. [50]

    van den Oord, A.; Vinyals, O.; and Kavukcuoglu, K. 2017. Neural Discrete Representation Learning. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA , 6306--6315

    2017

  43. [51]

    N.; Kaiser, L.; and Polosukhin, I

    Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; Kaiser, L.; and Polosukhin, I. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9,...

    2017

  44. [52]

    Wang, X.; Jiang, M.; Ma, Z.; Zhang, Z.; Liu, S.; Li, L.; Liang, Z.; Zheng, Q.; Wang, R.; Feng, X.; et al. 2025. Spark-tts: An efficient llm-based text-to-speech model with single-stream decoupled speech tokens. arXiv preprint arXiv:2503.01710

    2025 arXiv

  45. [53]

    Wang, Y.; Zhan, H.; Liu, L.; Zeng, R.; Guo, H.; Zheng, J.; Zhang, Q.; Zhang, X.; Zhang, S.; and Wu, Z. 2024. Maskgct: Zero-shot text-to-speech with masked generative codec transformer. arXiv preprint arXiv:2409.00750

    2024 arXiv

  46. [54]

    Yang, A.; Li, A.; Yang, B.; Zhang, B.; Hui, B.; Zheng, B.; Yu, B.; Gao, C.; Huang, C.; Lv, C.; Zheng, C.; Liu, D.; Zhou, F.; Huang, F.; Hu, F.; Ge, H.; Wei, H.; Lin, H.; Tang, J.; Yang, J.; Tu, J.; Zhang, J.; Yang, J.; Yang, J.; Zhou, J.; Zhou, J.; Lin, J.; Dang, K.; Bao, K.; ...

    2025 arXiv

  47. [55]

    Yang, D.; Wang, D.; Guo, H.; Chen, X.; Wu, X.; and Meng, H. 2024. Simplespeech: Towards simple and efficient text-to-speech with scalar latent transformer diffusion models. arXiv preprint arXiv:2406.02328

    2024 arXiv

  48. [56]

    Zhang, X.; Zhang, X.; Peng, K.; Tang, Z.; Manohar, V.; Liu, Y.; Hwang, J.; Li, D.; Wang, Y.; Chan, J.; et al. 2025. Vevo: Controllable zero-shot voice imitation with self-supervised disentanglement. arXiv preprint arXiv:2502.07243

    2025 arXiv

  49. [57]

    Zhou, K.; Sisman, B.; Liu, R.; and Li, H. 2021. Seen and Unseen Emotional Style Transfer for Voice Conversion with A New Emotional Speech Dataset. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 920--924

    2021

  50. [58]

    W.; and Li, H

    Zhou, K.; Sisman, B.; Rana, R.; Schuller, B. W.; and Li, H. 2023. Emotion Intensity and its Control for Emotional Voice Conversion. IEEE Trans. Affect. Comput. , 14(1): 31--48

    2023

  51. [59]

    Zhou, Y.; Qin, X.; Jin, Z.; Zhou, S.; Lei, S.; Zhou, S.; Wu, Z.; and Jia, J. 2024. Voxinstruct: Expressive human instruction-to-speech generation with unified multilingual codec language modelling. In Proceedings of the 32nd ACM International Conference on Multimedia, 554--563

    2024

  52. [60]

    , " * write output.state after.block = add.period write newline

    ENTRY address archivePrefix author booktitle chapter edition editor eid eprint howpublished institution isbn journal key month note number organization pages publisher school series title type volume year label extra.label sort.label short.list INTEGERS output.state before.all...

  53. [61]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.