Pith. sign in

REVIEW 3 major objections 6 minor 31 references

Goal-oriented Semantic Communications for Metaverse Construction via Generative AI and Optimal Transport

T0 review · 3 major / 6 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This paper claims that transmitting only nine semantic key points per camera view, with a shared knowledge base and a diffusion-plus-NeRF decoder, reconstructs a metaverse faster and more accurately than sending full images over wireless…

desk verdict Latency claim is credible and the system integration is new, but the OT denoiser is given clean transmitter keypoints as its target, so the accuracy improvements are supervised artifacts. read the letter →

arxiv 2411.16187 v2 pith:LZBZOMXW submitted 2024-11-25 eess.SY cs.SYeess.SP

Zhe Wang , Nan Li , Yansha Deng , A. Hamid Aghvami This is my paper · ORCID
classification eess.SYcs.SYeess.SP
keywords semanticcommunicationmetaverseconstructionoptimaltransportdenoisingkeypointextractionstablediffusionNeRFwirelesstransmissiongoal-oriented
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper is trying to establish that a metaverse scene can be built over wireless links from a tiny slice of semantic information instead of a full image stream. In its simulated industrial factory, a camera view is reduced to nine key points, encoding the positions of a moving box and a robotic arm, plus an initial shared knowledge base of scenery, camera, and object locations. The receiver then reconstructs multi-view images with a diffusion model and assembles the 3D scenery with NeRF. Against conventional image-based construction, the paper reports a 92.6% reduction in wireless construction latency, a 45.6% improvement in object-status accuracy, and a 44.7% improvement in viewing experience. The interest is in showing that meaning-preserving compression plus generative reconstruction can beat raw image delivery precisely when the channel is noisy.

What carries the argument

The mechanism that carries the argument is the pairing of a sparse key-point semantic representation with a shared knowledge base. The semantic encoder, an hourglass network, turns each camera image into nine heatmaps whose maxima define the key points of the moving objects; because the static factory, camera poses, and initial object positions are sent once as a knowledge base, only the small key-point set needs to travel for each update. The receiver's decoder is built from a ControlNet-enabled Stable Diffusion model that synthesizes multiple rotated views conditioned on key points, prompts, and canny edges, followed by NeRF, which lifts those images into a 3D point cloud. The OT-enabled denoiser is the added safeguard against channel noise: it computes a relaxed optimal-transport matrix between received and transmitted key-point sets, combines row- and column-constrained solutions in O($n^{2}$), and applies the correction only to points flagged by a view-consistency filter.

What would settle it

Re-run the reported 0 dB experiments with the OT denoiser's target distribution estimated only from the received noisy key points, or from a prior trained without the transmitter's clean points, and compare key point error with the claimed 5.3-10.2% OT gains; if the improvement disappears or reverses, the supervised access to the clean key points is what produced the denoising advantage.

Watch

Extended reading notes

Core claim

The paper's central claim, stated on its own terms, is that a goal-oriented semantic communication framework can replace bit-oriented image transmission in metaverse construction without losing the information that matters for object status and viewing experience. The transmitter extracts nine key points per view with an hourglass network, transmits those points over AWGN, Rayleigh, or Rician channels, and a receiver-side OT-enabled denoiser selectively corrects key points that disagree across camera angles. A ControlNet-conditioned Stable Diffusion decoder turns the corrected key points, text prompts, and canny-edge priors into multi-view images, and NeRF builds the metaverse point cloud from them. In the paper's experiments the semantic frameworks rank ahead of image-based construction across the metrics, with GSCS-OT reducing key point error by 45.6% and GSCM-OT reducing point-to-point error by 44.7% relative to ImageCom at 0 dB, and GSCS-OT cutting transmission latency by 92.6%.

Load-bearing premise

The weakest load-bearing assumption is that the OT denoiser's target distribution comes from the transmitter's clean key points: Algorithm 1 initializes the marginals from the known clean key-point set, but a real receiver does not know the clean values it is trying to reconstruct.

Editorial extensions

If this is right

  • If the reported gains hold, real-time metaverse construction does not need multi-gigabit image streams: nine key points per view plus a one-time knowledge base is enough to regenerate the scene.
  • At low SNR, a generative decoder with a shared prior can outperform full-image delivery because the prior supplies structure that the noisy channel has destroyed.
  • The OT denoiser is a compatible add-on to the semantic pipeline, contributing about 5.3-10.2% key-point-error improvement on top of diffusion-based reconstruction rather than being the whole accuracy story.
  • Latency shifts from the wireless link to receiver-side computation; semantic extraction, OT correction, and image generation together take less than two seconds per frame in the reported setup.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A practical extension would be a blind OT denoiser that estimates the target distribution from the received key points or a learned prior; without that, the 5.3-10.2% denoising gains are only validated in the supervised simulation setting.
  • The same transmit-once-shared-prior design should extend to larger metaverse scenes with more movable objects; the number of key points per view and the O(n^2) OT solve would grow, so the latency and accuracy trade-off would need re-testing.
  • Selective correction across views is a geometric consistency check; in deployments with heterogeneous UAV angles or occlusions, the threshold and neighboring-view window would likely need to adapt to the scene's motion model.
  • The framework implies that the receiver's compute budget, diffusion sampling and NeRF rendering, may become the next bottleneck for real-time metaverse updates, since the wireless transfer itself is no longer the dominant delay.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. The paper proposes a goal-oriented semantic communication (GSC) framework for wireless metaverse construction. The transmitter uses an hourglass-network encoder to extract a small set of keypoints (nine per camera view) from images, and the receiver reconstructs the metaverse scenery using a Stable Diffusion–based image generator and a NeRF-based 3D constructor, aided by a shared knowledge base. To combat channel noise, the authors add an optimal-transport (OT) denoiser that selectively corrects received keypoints. Experiments in a simulated industrial factory compare the proposed GSCS/GSCM variants (with and without OT) against a conventional full-image transmission baseline (ImageCom). The paper claims a 92.6% latency reduction, a 45.6% improvement in object status accuracy (KPE), and a 44.7% improvement in viewing experience (P2Point).

Significance. If the reported accuracy and latency results were valid, the paper would present a compelling demonstration that a semantic pipeline transmitting only nine keypoints per camera view, together with a generative decoder, can replace full-image wireless transmission for metaverse construction. The latency claim is structurally plausible, because transmitting nine points instead of 1200×600 images must reduce transmission time. The architectural integration of keypoint extraction, Stable Diffusion, NeRF, and OT is also potentially interesting. However, the accuracy and viewing-experience claims are not supported as presented because the OT denoiser is evaluated with oracle access to the clean transmitter keypoints, as detailed below. The paper does provide a concrete algorithm (Algorithm 1), a clear experimental setup, and comparisons across AWGN, Rayleigh, and Rician channels, which are strengths. If the oracle issue can be resolved, the framework could be a meaningful step toward low-latency metaverse construction.

major comments (3)
  1. [Section IV.A and Algorithm 1] The OT denoiser uses the transmitter's clean keypoint distribution as its optimization target. Eq. (20) defines the transport problem as moving mass from the received distribution Dr to the distribution Dt of the 'original point vectors at the transmitter side'. Algorithm 1 line 5 initializes both marginal distributions p_i and q_j from K_i (the clean keypoint set), and line 26 computes the denoised points as T*·K_i. In a deployed receiver, the clean transmitter keypoints are not available, so this denoiser cannot be implemented as described. Consequently, the reported KPE gains of 5.3% (GSCS-OT over GSCS) and 10.2% (GSCM-OT over GSCM) at 0 dB (Section V.C), as well as the headline 45.6% accuracy improvement over ImageCom, measure a supervised/oracle procedure rather than a communication system. This is a load-bearing issue because the central accuracy and viewing-experience claims rest on these numbers.
  2. [Algorithm 1 vs. Section IV.A] If the authors intended K_i in Algorithm 1 to denote the received noisy keypoints rather than the clean transmitter keypoints, then p and q are both initialized from the same noisy set, and the transport matrix T* would map the noisy distribution onto itself. In that case, Eq. (20) and the accompanying text about 'original point vectors at the transmitter side' are internally inconsistent, and the OT step would provide no denoising relative to the clean source. The manuscript must resolve this ambiguity, either by reformulating the OT problem as a blind denoiser that does not require the clean transmitter distribution or by explicitly stating the oracle assumption and re-evaluating all accuracy claims without access to the transmitter's keypoints.
  3. [Eq. (9) and Section V.C] The KPE metric in Eq. (9) is defined using 'three dimensional position value' of keypoints, but Section V.C states that the error is measured using the Euclidean distance between the key points' two-dimensional positions. Since the keypoints are extracted from 2D heatmaps (Section III.B), the use of 2D distances is plausible, but the inconsistency between the metric definition and the actual evaluation makes it difficult to interpret the quantitative claims. Please clarify the exact coordinates used in KPE and align the definition with the experimental protocol.
minor comments (6)
  1. [Section V.A] The text says 'Section IV-A provides insights into the configuration of metaverse scenarios and OT denoiser' but the experiment setup is actually in Section V-A. Similarly, Section V.B refers to 'Section IV-B' for experimental results; the correct cross-reference is Section V.B.
  2. [Eq. (7)] The problem formulation contains typos: 'min_{Pr} C(P_t, P_t)' should presumably be 'C(P_t, P_r)', and 'trθ,δru' is garbled. Please proofread the equation.
  3. [Section IV.A] The paper claims that traditional OT with Sinkhorn-Knopp has O(n^3) complexity, but Sinkhorn's algorithm is O(n^2) per iteration. The stated O(n^2) complexity of the proposed relaxed algorithm is therefore not a fair comparison as written.
  4. [Algorithm 1] The regularization parameter is denoted ε in Algorithm 1 but η in Section IV.A. Please use a consistent symbol.
  5. [Section V.F] The sentence 'the GSCS-OT framework also achieves an 92.6% reduction' has a grammatical error; also the units or scale of the latency values in Fig. 12 are not specified.
  6. [References] Reference [21] cites AnimateDiff rather than the original Stable Diffusion paper; the correct source should be cited. Reference [26] appears unrelated to optimal transport and should be replaced with a standard OT reference.

Circularity Check

1 steps flagged · score 6.0 of 10

OT denoiser evaluated with oracle access to clean transmitter keypoints; reported accuracy gains reduce by construction (Algorithm 1 lines 5 and 26, Section IV.A).

  1. self definitional [Section IV.A, Eq. (20); Algorithm 1 lines 5 and 26; Section V.C]
    "Given the received key point vectors K' at the receiver side and the original point vectors at the transmitter side K, with their respective probability distributions Dr and Dt, the goal of the OT-enabled semantic denoising algorithm is to find an optimal transport matrix Tij that minimizes the correction cost from Dr to Dt. ... Algorithm 1: 'Initialize marginal distributions pi and qj from Ki.' 'Update key points for unfiltered data: Ki_hat = (T* * Ki) where Fi = 0.'"

    The OT denoiser is defined to match the received key-point distribution Dr to the transmitter-side distribution Dt of the original clean keypoint vectors. Algorithm 1 then initializes both marginals p_i and q_j from K_i, and sets the denoised output to T* * K_i. A deployed receiver only has the noisy received points, not the clean K_i, so the denoiser is given the ground truth it is supposed to recover. Consequently, the reported OT gains (5.3% over GSCS, 10.2% over GSCM at 0 dB, and part of the 45.6% KPE improvement over ImageCom) measure an oracle-assisted procedure rather than a deployable communication system. If K_i is instead interpreted as the received noisy keypoints, then Eq.

full rationale

The central circularity is localized to the OT-enabled semantic denoiser. Section IV.A poses the OT problem using the transmitter's original point vectors as the target distribution, and Algorithm 1 initializes both marginals from K_i and updates the denoised keypoints with T* * K_i. This hands the algorithm the clean keypoints it is supposed to recover, so the OT-specific accuracy gains (GSCS-OT over GSCS, GSCM-OT over GSCM) reduce by construction rather than by independent denoising. The headline accuracy and viewing-experience claims incorporate these gains and are therefore partially circular. This does not invalidate the entire paper: the 92.6% latency reduction follows from transmitting nine keypoints per view instead of full images and does not depend on the OT oracle; the knowledge-base design and diffusion/NeRF reconstruction pipeline are also independently meaningful. No load-bearing self-citation chain or imported uniqueness theorem appears; the issue is the supervised, oracle-accessible evaluation of the OT denoiser. Score 6 reflects that some predictions reduce by construction but the framework retains substantial independent content.

Assumptions & free parameters 6 free parameters · 5 assumptions · 0 invented entities

No new physical entities, particles, or mediators are introduced; the knowledge base and key point vocabulary are design artifacts counted in the free parameters and axioms above. The central claim pulls heavy weight from prior components (Stable Diffusion, NeRF, OT) and from unstated hyperparameters, so the ledger is dominated by fitting choices and domain assumptions rather than invented entities.

free parameters (6)
  • OT entropy regularization eta (epsilon in Algorithm 1) = not reported
    Controls the entropy penalty in Eq. (20) and the cost scaling in Algorithm 1; no value or sensitivity study is given.
  • Selective correction threshold delta = not reported
    Threshold in Eq. (30) deciding which key points are corrected; chosen by hand.
  • Control weights omega_c, omega_k, omega_b = not reported
    Weights balancing canny, robotic arm, and moving box conditions in the Stable Diffusion decoder (Eq. 18); no values or ablations given.
  • Number and placement of key points = 9 per view (7 robotic arm, 2 box)
    Design choice from Table II; no ablation shows that nine points are sufficient for reconstruction.
  • Column marginal q_j for OT = transmitter key point distribution
    Algorithm 1 line 5 initializes q_j from the clean key points K_i; this is a supervised target rather than an observable quantity.
  • Row marginal p_i for OT = uniform
    Section IV.A states p is the uniform importance weight of each point in the source set; a modeling choice without justification.
assumptions (5)
  • domain assumption The knowledge base (canny images, camera parameters, object locations at t=0) can be transmitted once and remains valid for the whole session.
    Invoked in Section III.A; if the movable-object base becomes stale, the decoder's object attachment fails.
  • domain assumption Nine key points per view capture all movable-object state needed to regenerate accurate metaverse scenery.
    Sections III.B and Table II; no ablation explores key point count or placement.
  • standard math Stable Diffusion reverse diffusion, ControlNet conditioning, and NeRF volume rendering behave as cited and generalize to this factory scene.
    Equations (13) to (17) rely on references [21], [31], and [22]; the paper does not state whether fine-tuning or pretrained weights were used.
  • standard math Entropy-regularized optimal transport and the Lagrange relaxation solve the transport problem in Eq. (20).
    Section IV.A; the element-wise max of the relaxed solutions is not proven to satisfy the marginal constraints.
  • domain assumption The wireless channel is adequately modeled by convolving image data with a Rayleigh fading matrix plus additive noise, with no CSI feedback or equalization.
    Equations (3) and (4); the convolutional channel model is unusual and the receiver processing assumes synchronization.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Goal-oriented Semantic Communications for Metaverse Construction via Generative AI and Optimal Transport." pith.science (2026). https://pith.science/paper/LZBZOMXW

@misc{pith2026241116187,
  author       = {Pith},
  title        = {Pith review of: Goal-oriented Semantic Communications for Metaverse Construction via Generative AI and Optimal Transport},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LZBZOMXW}},
  note         = {Machine review of arXiv:2411.16187}
}
read the original abstract

The emergence of the metaverse has boosted productivity and creativity, driving real-time updates and personalized content, which will substantially increase data traffic. However, current bit-oriented communication networks struggle to manage this high volume of dynamic information, restricting metaverse applications interactivity. To address this research gap, we propose a goal-oriented semantic communication (GSC) framework for metaverse. Building on an existing metaverse wireless construction task, our proposed GSC framework includes an hourglass network-based (HgNet) encoder to extract semantic information of objects in the metaverse; and a semantic decoder that uses this extracted information to reconstruct the metaverse content after wireless transmission, enabling efficient communication and real-time object behaviour updates to the scenery for metaverse construction task. To overcome the wireless channel noise at the receiver, we design an optimal transport (OT)-enabled semantic denoiser, which enhances the accuracy of metaverse scenery through wireless communication. Experimental results show that compared to the conventional metaverse construction, our proposed GSC framework significantly reduces wireless metaverse construction latency by 92.6\%, while improving metaverse object status accuracy and viewing experience by 45.6\% and 44.7\%, respectively.

Figures

Figures reproduced from arXiv: 2411.16187 by the authors.

Figure 1
Figure 1. Metaverse Construction Task the paper. II. SYSTEM MODEL AND PROBLEM FORMATION In this section, we provide an overview of the traditional wireless metaverse construction tasks and the problem for￾mulation. As shown in [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Goal-oriented Semantic Communication Framework for the Metaverse Construction [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 4
Figure 4. Semantic Encoder TABLE I: HgNet Architecture HgNet Parameters Input Value Residual Block 1 (up1) (256,256,128) MaxPool (256,256,128) Recursive HourGlass (n=3) (128,128,128) Upsample (up2) (128,128,128) Final Output (up1 + up2) (256,256,128) Batch Size 40 Momentum 0.9 Weight Decay 10´4 metaverse scenery, allow them to be correctly placed after being constructed based on images. B. Semantic Encoder Section II.B detail… view at source ↗
Figures from the paper (8 more)
Figure 3
Figure 3. Figure 3: Knowledge Base Extraction consists of four main modules: the knowledge base extraction module, which gathers and updates essential static knowledge base; the semantic encoder, which takes images as input and generates 1D semantic information as output; the wireless com…
Figure 5
Figure 5. Figure 5: Semantic Decoder for Metaverse Construction [PITH_FULL_IMAGE:figures/full_fig_p006_5.png]
Figure 6
Figure 6. Figure 6: Semantic Denoiser Dr to Dt, which can be represented as min T ÿn i“1 ÿn j“1 Tij cij ` η ÿn i“1 ÿn j“1 Tij plog Tij ´ 1q, subject to ÿn j“1 Tij “ pi , ÿn i“1 Tij “ qi , (20) where pi represents the row marginal distribution of the received data. Tij represents the amoun…
Figure 7
Figure 7. Figure 7: Denoising Performance under Rayleigh and Rician Channels [PITH_FULL_IMAGE:figures/full_fig_p009_7.png]
Figure 8
Figure 8. Figure 8: Key Point Error (a) AWGN. (b) Rayleigh. (c) Rician [PITH_FULL_IMAGE:figures/full_fig_p010_8.png]
Figure 9
Figure 9. Figure 9: Point-to-point C. Key Points Transmission Accuracy [PITH_FULL_IMAGE:figures/full_fig_p010_9.png]
Figure 10
Figure 10. Figure 10: Metaverse Construction with SNR Decrease [PITH_FULL_IMAGE:figures/full_fig_p011_10.png]
Figure 12
Figure 12. Figure 12: Transmission Latency ranked as Hourglass ą PointConv ą RsNet ą EfficientNet. The performance highlights the superior location prediction ability of the Hourglass-based semantic encoder in keypoint detection, achieving impressive accuracy with a margin of less than 3 p…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

31 extracted references · 30 canonical work pages

  1. [1]

    A survey on metaverse: Fundamentals, security, and privacy,

    Y . Wang, Z. Su, N. Zhang, R. Xing, D. Liu, T. H. Luan, and X. Shen, “A survey on metaverse: Fundamentals, security, and privacy,” IEEE Commun. Surv. Tutor ., vol. 25, no. 1, pp. 319– 352, First Quarter 2022

    work page 2022

  2. [2]

    Metaverse: Perspectives from graphics, interactions and visualization,

    Y . Zhao, J. Jiang, Y . Chen, R. Liu, Y . Yang, X. Xue, and S. Chen, “Metaverse: Perspectives from graphics, interactions and visualization,” Vis. Inform., vol. 6, no. 1, pp. 56–67, Mar. 2022

    work page 2022

  3. [3]

    Research on the application of metaverse technology in the field of intelligent transportation,

    M. Hu and L. Cheng, “Research on the application of metaverse technology in the field of intelligent transportation,” in Int. Conf. Metaverse. Springer, 2023, pp. 98–107

    work page 2023

  4. [4]

    The metaverse from a multimedia communications perspective,

    H. Dong and J. S. A. Lee, “The metaverse from a multimedia communications perspective,” IEEE MultiMedia, vol. 29, no. 4, pp. 123–127, Oct. 2022

    work page 2022

  5. [5]

    What is the metaverse? definitions, technologies and the community of inquiry,

    D. T. K. Ng, “What is the metaverse? definitions, technologies and the community of inquiry,” Australas. J. Educ. Technol. , vol. 38, no. 4, pp. 190–205, Oct. 2022

    work page 2022

  6. [6]

    ISCom: Interest-aware semantic communication scheme for point cloud video streaming on metaverse XR devices,

    Y . Huang, B. Bai, Y . Zhu, X. Qiao, X. Su, L. Yang, and P. Zhang, “ISCom: Interest-aware semantic communication scheme for point cloud video streaming on metaverse XR devices,” IEEE J. Sel. Areas Commun. , vol. 41, no. 10, pp. 1234–1246, Oct. 2023

    work page 2023

  7. [7]

    Exploring practical use-cases of augmented reality using photogrammetry and other 3d reconstruction tools in the metaverse,

    A. Singh, S. Mishra, S. Jain, S. Dogra, A. Awasthi, N. R. Roy, and K. Sodhi, “Exploring practical use-cases of augmented reality using photogrammetry and other 3d reconstruction tools in the metaverse,” Augment. Virtual Reality Ind. 5.0 , vol. 2, p. 163, 2023

    work page 2023

  8. [8]

    360- degree video bandwidth reduction: Technique and approaches comprehensive review,

    E. S. Wong, N. H. A. Wahab, F. Saeed, and N. Alharbi, “360- degree video bandwidth reduction: Technique and approaches comprehensive review,”Appl. Sci., vol. 12, no. 15, p. 7581, Aug. 2022

    work page 2022

Show all 31 references
  1. [9]

    Reconstruction of neural radiance fields with vivid scenes in the metaverse,

    W. Jing, S. Wang, W. Zhang, and C. Li, “Reconstruction of neural radiance fields with vivid scenes in the metaverse,” IEEE Trans. Consum. Electron. , vol. 69, no. 4, pp. 450–460, Oct. 2023

    2023

  2. [10]

    Less data, more knowledge: Building next-generation semantic communication networks,

    C. Chaccour, W. Saad, M. Debbah, Z. Han, and H. V . Poor, “Less data, more knowledge: Building next-generation semantic communication networks,” IEEE Commun. Surv. Tutor ., vol. 26, no. 1, pp. 10–30, First Quarter 2024

    2024

  3. [11]

    Knowledge-enhanced semantic communication sys- tem with ofdm transmissions,

    X. Xu, H. Xiong, Y . Wang, Y . Che, S. Han, B. Wang, and P. Zhang, “Knowledge-enhanced semantic communication sys- tem with ofdm transmissions,” Sci. China Inf. Sci., vol. 66, no. 7, p. 172302, Jul. 2023

    2023

  4. [12]

    Magicstream: Bandwidth-conserving immersive telepresence via semantic communication,

    R. Cheng, N. Wu, V . Le, E. Chai, M. Varvello, and B. Han, “Magicstream: Bandwidth-conserving immersive telepresence via semantic communication,” in Proc. 22nd ACM Conf. Embed. Netw. Sens. Syst. (SenSys) . ACM, Jan. 2024, pp. 365–379

    2024

  5. [13]

    Video semantic communication with major object extraction and contextual video encoding,

    H. Li, H. Tong, S. Wang, N. Yang, Z. Yang, and C. Yin, “Video semantic communication with major object extraction and contextual video encoding,” arXiv Preprint , vol. 2402, p. 01330, 2024

    2024

  6. [14]

    Deep joint source- channel coding using overlap image division for block noise reduction,

    R. Yamamoto, Y . Inoue, and D. Hisano, “Deep joint source- channel coding using overlap image division for block noise reduction,” in Proc. IEEE 99th V eh. Technol. Conf. (VTC2024- Spring). IEEE, Apr. 2024, pp. 1–6

    2024

  7. [15]

    An introduction to joint source and channel coding,

    R. C. Jain, “An introduction to joint source and channel coding,” IETE J. Educ. , vol. 46, no. 3, pp. 121–127, Sep. 2005

    2005

  8. [16]

    A semantic communication and vvc-based hybrid video coding system,

    P. Samarathunga, Y . Ganearachchi, T. Fernando, A. Jayasingam, I. Alahapperuma, and A. Fernando, “A semantic communication and vvc-based hybrid video coding system,” IEEE Access , vol. 12, pp. 15 000–15 012, Jan. 2024

    2024

  9. [17]

    Md- vsc—wireless model division video semantic communication for 6g,

    Z. Bao, H. Liang, C. Dong, X. Xu, and G. Liu, “Md- vsc—wireless model division video semantic communication for 6g,” in Proc. IEEE Globecom Workshops (GC Wkshps) . IEEE, Dec. 2023, pp. 1572–1578

    2023

  10. [18]

    Wireless deep video semantic transmission,

    S. Wang, J. Dai, Z. Liang, K. Niu, Z. Si, C. Dong, X. Qin, and P. Zhang, “Wireless deep video semantic transmission,” IEEE J. Sel. Areas Commun. , vol. 41, no. 1, pp. 214–229, Jan. 2022

    2022

  11. [19]

    Sora as an AGI world model? a complete survey on text-to-video generation,

    J. Cho, F. D. Puspitasari, S. Zheng, J. Zheng, L.-H. Lee, T.-H. Kim, C. S. Hong, and C. Zhang, “Sora as an AGI world model? a complete survey on text-to-video generation,” arXiv Preprint, vol. 2403, p. 05131, 2024

    2024

  12. [20]

    Sora: A review on background, technology, limitations, and opportunities of large vision mod- els,

    Y . Liu, K. Zhang, Y . Li, Z. Yan, C. Gao, R. Chen, Z. Yuan, 13 Y . Huang, H. Sun, J. Gao,et al., “Sora: A review on background, technology, limitations, and opportunities of large vision mod- els,” arXiv Preprint, vol. 2402, p. 17177, 2024

    2024

  13. [21]

    Animatediff: Animate your personalized text-to-image diffusion models without specific tuning,

    Y . Guo, C. Yang, A. Rao, Z. Liang, Y . Wang, Y . Qiao, M. Agrawala, D. Lin, and B. Dai, “Animatediff: Animate your personalized text-to-image diffusion models without specific tuning,” arXiv preprint arXiv:2307.04725 , 2023

    2023 arXiv

  14. [22]

    NeRF: Representing scenes as neural radiance fields for view synthesis,

    B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ra- mamoorthi, and R. Ng, “NeRF: Representing scenes as neural radiance fields for view synthesis,” Commun. ACM , vol. 65, no. 1, pp. 99–106, Jan. 2021

    2021

  15. [23]

    A tale of two features: Stable diffu- sion complements dino for zero-shot semantic correspondence,

    J. Zhang, C. Herrmann, J. Hur, L. Polania Cabrera, V . Jampani, D. Sun, and M.-H. Yang, “A tale of two features: Stable diffu- sion complements dino for zero-shot semantic correspondence,” Adv. Neural Inf. Process. Syst. , vol. 36, 2024

    2024

  16. [24]

    Point-NeRF: Point-based neural radiance fields,

    Q. Xu, Z. Xu, J. Philip, S. Bi, Z. Shu, K. Sunkavalli, and U. Neumann, “Point-NeRF: Point-based neural radiance fields,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2022, pp. 5438–5448

    2022

  17. [25]

    Unbalanced optimal transport: From theory to numerics,

    T. S ´ejourn´e, G. Peyr ´e, and F.-X. Vialard, “Unbalanced optimal transport: From theory to numerics,” Handb. Numer . Anal. , vol. 24, pp. 407–471, Jan. 2023

    2023

  18. [26]

    Stochas- tic models and processing probabilistic data for solving the problem of improving the electric freight transport reliability,

    N. V . Martyushev, B. V . Malozyomov, O. A. Filina, S. N. Sorokova, E. A. Efremenkov, D. V . Valuev, and M. Qi, “Stochas- tic models and processing probabilistic data for solving the problem of improving the electric freight transport reliability,” Mathematics, vol. 11, no. 23...

    2023

  19. [27]

    Semantic channel equalizer: Modelling language mismatch in multi-user semantic commu- nications,

    M. Sana and E. C. Strinati, “Semantic channel equalizer: Modelling language mismatch in multi-user semantic commu- nications,” in Proc. IEEE Glob. Commun. Conf. (GLOBECOM) . IEEE, Dec. 2023, pp. 2221–2226

    2023

  20. [28]

    Semantic correspon- dence as an optimal transport problem,

    Y . Liu, L. Zhu, M. Yamada, and Y . Yang, “Semantic correspon- dence as an optimal transport problem,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR) , Jun. 2020, pp. 4463–4472

    2020

  21. [29]

    Impact of resolution, colour, and motion on object identification in digital twins from robot sensor data,

    P. Bremner and M. Giuliani, “Impact of resolution, colour, and motion on object identification in digital twins from robot sensor data,” Front. Robot. AI , vol. 9, p. 995342, Dec. 2022

    2022

  22. [30]

    Evalua- tion criteria for PCC (point cloud compression),

    R. Mekuria, Z. Li, C. Tulvan, and P. Chou, “Evalua- tion criteria for PCC (point cloud compression),” ISO/IEC JTC1/SC29/WG11, Tech. Rep. N16332, Jun. 2016

    2016

  23. [31]

    Adding conditional control to text-to-image diffusion models,

    L. Zhang, A. Rao, and M. Agrawala, “Adding conditional control to text-to-image diffusion models,” in Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV) , Oct. 2023, pp. 3836–3847

    2023

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.