REVIEW 3 cited by
Large Generative Model-assisted Talking-face Semantic Communication System
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The rapid development of generative Artificial Intelligence (AI) continually unveils the potential of Semantic Communication (SemCom). However, current talking-face SemCom systems still encounter challenges such as low bandwidth utilization, semantic ambiguity, and diminished Quality of Experience (QoE). This study introduces a Large Generative Model-assisted Talking-face Semantic Communication (LGM-TSC) System tailored for the talking-face video communication. Firstly, we introduce a Generative Semantic Extractor (GSE) at the transmitter based on the FunASR model to convert semantically sparse talking-face videos into texts with high information density. Secondly, we establish a private Knowledge Base (KB) based on the Large Language Model (LLM) for semantic disambiguation and correction, complemented by a joint knowledge base-semantic-channel coding scheme. Finally, at the receiver, we propose a Generative Semantic Reconstructor (GSR) that utilizes BERT-VITS2 and SadTalker models to transform text back into a high-QoE talking-face video matching the user's timbre. Simulation results demonstrate the feasibility and effectiveness of the proposed LGM-TSC system.
Forward citations
Cited by 3 Pith papers
-
Visual Fidelity Index for Generative Semantic Communications with Critical Information Embedding
The paper introduces GVIF, a mutual-information-based metric for visual fidelity in generative semantic communication, and uses it to adaptively select critical image features and compression levels for wireless transmission.
-
From Large AI Models to Agentic AI: A Tutorial on Future Intelligent Communications
This paper is a broad tutorial on applying LAMs and agentic AI to 6G, largely restating existing research rather than introducing new results.
-
A Comprehensive Survey of Large AI Models for Future Communications: Foundations, Applications and Challenges
A survey organizing the growing literature on large AI models for 6G communications, with a classification of model types, training and evaluation methods, and a list of challenges.
Discussion (0). Continue with ORCID to comment.