Pith. sign in

REVIEW 2 cited by

Hear Your Face: Face-based voice conversion with F0 estimation

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2408.09802 v1 pith:22DR5LJH submitted 2024-08-19 cs.SD cs.CVeess.AS

classification cs.SDcs.CVeess.AS
keywords voiceconversionface-basedfacialcharacteristicsfeaturesframeworkfrequency
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

This paper delves into the emerging field of face-based voice conversion, leveraging the unique relationship between an individual's facial features and their vocal characteristics. We present a novel face-based voice conversion framework that particularly utilizes the average fundamental frequency of the target speaker, derived solely from their facial images. Through extensive analysis, our framework demonstrates superior speech generation quality and the ability to align facial features with voice characteristics, including tracking of the target speaker's fundamental frequency.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Emotional Face-to-Speech

    cs.SD 2025-02 conditional novelty 6.0 of 10

    A discrete diffusion transformer with curriculum learning generates emotional speech from identity and emotion cues extracted from a face image.

  2. MultiActor-Audiobook: Zero-Shot Audiobook Generation with Faces and Voices of Multiple Speakers

    cs.SD 2025-05 conditional novelty 5.0 of 10

    A zero-shot pipeline that creates character voices from AI-generated faces and LLM-written prosody instructions can produce expressive audiobooks without extra training or manual annotation, though human quality score...

Pith tools