Pith. sign in

REVIEW 3 major objections 4 minor 1 cited by

A training trick called knowledge distillation lets small neural networks match the compression quality of large ones while cutting compute, memory, and energy use.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Knowledge-distilled students with 64 or more channels match the rate-distortion performance of a 128-channel teacher while cutting memory by 68% and energy by 34%.

T0 review reviewed 2026-08-04 challenge →

load-bearing objection A useful, honest empirical sweep of KD for learned compression, but the missing from-scratch baseline leaves the central causal claim untested. the 3 major comments →

arxiv 2509.10366 v1 pith:UZNRNYMT submitted 2025-09-12 cs.CV

Efficient Learned Image Compression Through Knowledge Distillation

classification cs.CV
keywords learned image compressionknowledge distillationrate-distortion tradeoffscale hyperpriorfrugal AImodel compressionresource-constrained platformsPSNR
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to show that knowledge distillation (KD), the practice of training a small model on the outputs of a large one, can make learned image compression models frugal enough for resource-limited devices without sacrificing much quality. Using the scale hyperprior architecture, the authors train student models with 16 to 112 channels under a loss that combines distillation on the latent and reconstructed image with a rate-distortion term. They report that students with 64 or more channels reach nearly the same PSNR and bit rate as a 128-channel teacher, while the 64-channel student cuts parameter count by 67 percent, FLOPs by 72 percent, and per-frame energy by 34 percent. If correct, this means KD lets smaller models replace large ones on memory- or battery-constrained platforms at about one percent PSNR cost, and the paper also shows the teacher can steer students toward either higher quality or lower bit rate.

Core claim

On the scale hyperprior compression model, knowledge distillation transfers most of a teacher's rate-distortion behavior to smaller students. A student with 64 channels reaches 34.11 dB PSNR at 0.66 bpp against the teacher's 34.53 dB at 0.67 bpp, a 1.2 percent PSNR drop with 66.6 percent fewer parameters, 71.8 percent fewer FLOPs, and 34.2 percent lower energy per frame. Students with fewer than 64 channels degrade more sharply, while 96- and 112-channel students sit nearly on the teacher's RD curve. Distilling the hyper-latent space adds only marginal gains in this setup, and using a teacher that prioritizes bit rate shifts students toward lower bit rates.

What carries the argument

The mechanism is a composite distillation loss added to the student's rate-distortion objective. The loss, L1 = λ1 MSE(ŷ_student, ŷ_teacher) + λ2 MSE(x̂_student, x̂_teacher) + λ3 RD(ŷ_student, x̂_student, x), forces the student's latent representations and reconstructed images to imitate the teacher's while still optimizing rate and distortion; a second variant L2 also distills the hyper-latent used by the entropy model. The teacher is a pre-trained 128-channel scale hyperprior model, and smaller students shrink only the channel count while keeping the latent-space size fixed.

Load-bearing premise

The paper credits the students' performance to knowledge distillation, but it never trains a same-size student from scratch with the same recipe, so it remains possible that the smaller models would reach similar quality even without a teacher.

What would settle it

Train a 64-channel scale hyperprior student from scratch for 4-5 million steps on Vimeo90K with the same rate-distortion loss; if it matches the KD student's roughly 34.1 dB PSNR at 0.66 bpp on Kodak, the attribution of the gain to distillation collapses.

Watch this falsifier. Get emailed when new claim-graph text bears on it.

If this is right

  • A 64-channel KD student can replace a 5.08M-parameter teacher on memory-limited devices with roughly a one-percent PSNR drop.
  • The KD student with 64 channels reduces memory by 68 percent, FLOPs by 72 percent, and per-frame energy by 34 percent, making it a direct candidate for real-time compression on edge hardware.
  • Choosing a teacher trained for low bit rate shifts students toward lower bit rates, so KD gives a way to steer the compression-quality tradeoff without redesigning the architecture.
  • All student models exceed 200 frames per second on the measured GPU, leaving headroom for higher resolution or lower energy operation.
  • Extending KD to the hyper-latent space yields only small gains for larger students, so the main benefit comes from distilling the main latent and reconstruction.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The paper's causal claim would be stronger with a same-size student trained from scratch under the same recipe; without that control, part of the reported gain could be due to longer training or the choice of a 128-channel baseline.
  • Energy and throughput were measured on one high-end GPU; actual performance on memory- or battery-constrained platforms is likely to differ, so the frugal-AI conclusion should be re-tested on target hardware.
  • The authors note KD can be extended to transformer-based models; one could also try perceptual or GAN-based teachers to see whether students inherit better visual quality rather than just PSNR.
  • Since KD on the hyper-latent gave marginal gains here, a natural next test is to distill a richer entropy model, such as an autoregressive prior, to see whether the benefit grows with the complexity of the teacher's probability model.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. The paper applies knowledge distillation (KD) to a learned image compression model (Ballé et al.'s scale hyperprior from compressAI) and evaluates whether smaller 'student' networks can match a larger 'teacher' model in rate–distortion performance while reducing memory, compute, and energy. Students with 16–112 channels are trained using a loss that combines latent-space, reconstruction, and rate–distortion terms (Eqs. 1–3). The central reported results are that students with 64 or more channels perform roughly on par with the 128-channel teacher on the Kodak dataset: the 64-channel student reaches 34.11 dB PSNR at 0.66 bpp versus the teacher's 34.53 dB at 0.67 bpp, while reducing parameters by about 67%, FLOPs by 72%, and per-frame energy by 34% (Tables 2–4). The paper also explores different λ tradeoffs, KD loss weights, hyper-latent distillation, and hybrid teachers, concluding that KD enables smaller models to be used on resource-constrained platforms.

Significance. If the reported results are causal and reproducible, the paper provides a practical recipe for deploying lighter learned image compression models: a 64-channel student can approximate a 128-channel teacher with only about 1% PSNR loss while saving substantial memory and compute. The measurements are grounded in external references—the teacher is a compressAI pretrained checkpoint, RD performance is evaluated on Kodak, and resource numbers are measured rather than assumed. The public code and explicit training details are strengths. The main significance is constrained by the lack of a same-size from-scratch student control, so the paper currently establishes that small architectures trained with this recipe have attractive RD/resource trade-offs, but not specifically that KD is the cause of the improvement.

major comments (3)
  1. [§5.1.1, Figure 2; Abstract; §5.1.2] The causal claim that KD improves student performance is not tested. The abstract states that students can achieve 'better performance than when trained independently', and §5.1.2 asserts that some students 'perform better than what they would have if trained alone', but no same-size student is ever trained without KD. All comparisons are against the 128-channel teacher or pretrained 128-channel models (Tables 2–4). A 64-channel model trained from scratch on Vimeo90K with the same 4–5M steps, batch size 16, learning-rate schedule, and the same RD loss (i.e., Eq. 3 without the KD terms) could plausibly reach close to 34.11 dB / 0.66 bpp, in which case the 'KD improves compression' claim would collapse to a claim about architecture size. This is load-bearing for the paper's central message and needs a dedicated baseline.
  2. [Tables 2–4 and Figures 2–12] All reported RD and resource numbers are point estimates from a single run per configuration, evaluated on 24 Kodak images, with no error bars, no multiple seeds, and no significance testing. Differences such as 34.44 vs. 34.41 dB or 0.66 vs. 0.67 bpp are used to support qualitative claims about which student size is 'best' and which KD hyperparameters matter. These differences may be within training/evaluation noise. At minimum, the paper should report variance across seeds for the main 64-channel student and the teacher, or explicitly caution that rankings by small margins are not established.
  3. [§5.2 and Appendix A.1] The 'resource-constrained platform' conclusion is based on measurements on an Nvidia RTX 3090, a high-end desktop GPU. Throughput and energy per frame measured there do not necessarily transfer to smartphones, IoT devices, or FPGAs, which are the platforms named in the introduction. The parameter/FLOP reductions are architecture-level and likely transfer, but the specific energy savings (e.g., 34% for the 64-channel student) and the recommendation for 'resource-constrained platforms' rest on unverified hardware transfer. Either add measurements on a representative edge device or soften the claims to be about model complexity and desktop-GPU measurements.
minor comments (4)
  1. [Table 5] The JPEG/WebP rows appear misaligned or duplicated (e.g., repeated WebP values and inconsistent row grouping). Please reformat so each codec/setting is a single row with matching throughput, energy, PSNR, and bpp.
  2. [§5.1.2, Figure 6] The names 'student_5_1', 'student_5_2', and 'student_5_3' are not introduced in the figure caption or text; clarify the mapping to hyperparameter sets to improve readability.
  3. [Throughout] Typographical issues: 'WepP' should be 'WebP'; §5.1.2 contains an extra space in 'weigthing'; the sentence following Figure 8 repeats 'Figure 8' twice. A light proofreading pass is needed.
  4. [§4.3 and Figures 19–21] When comparing with JPEG/WebP/JPEG-2000, the operating points in Table 5 are extremely different (e.g., PSNR 70 dB at 13.45 bpp for JPEG-2000). Discussing the RD and energy trade-offs would be clearer if the comparisons were at matched quality or bit rate, or if this limitation is explicitly acknowledged.

Circularity Check

0 steps flagged

No significant circularity: student RD results are measured against external Kodak/compressAI references, and the KD losses in Eqs. (1)-(3) are the method being evaluated, not a prediction derived from a fitted input.

full rationale

The paper's derivation chain is self-contained. The teacher is an external compressAI pre-trained checkpoint (Sec. 4.2), the student objectives are the stated distillation losses of Eqs. (1)-(3), and the reported outcomes are PSNR/BPP on the external Kodak set plus measured FLOPs, throughput, and energy on an RTX 3090 (Tables 2-4). None of these quantities is defined in terms of the headline result, and no equation reduces to an input by construction: the RD term in Eq. (3) is the standard rate-distortion objective, and the MSE feature/reconstruction terms in Eqs. (1)-(2) are the method being evaluated, not a prediction derived from it. The two references to prior work by co-authors ([12], [13]) are related-work mentions about FPGA deployment and are not used to justify the students' RD performance. The main weaknesses are experimental-control and selection issues rather than circularity: no same-size student trained from scratch without KD is compared (Sec. 5.1.1, Fig. 2), and the 64-channel size/KD weights were chosen after inspecting Kodak results (Sec. 5.1.2). These are important validity concerns for the causal claim that KD itself improves compression, but they do not make any stated result equivalent to its own input by definition. Therefore the appropriate circularity score is 0.

Axiom & Free-Parameter Ledger

3 free parameters · 5 axioms · 0 invented entities

No new entities are postulated; 'hybrid knowledge distillation' is a second teacher added to an existing loss and introduces no new physical or algorithmic object. The free parameters are the KD loss weights (hand-tuned by inspecting Kodak curves), the RD Lagrange multiplier values inherited from CompressAI, and the channel-count design choices. Five domain assumptions carry the conclusions: KD transfers generalization, compressAI checkpoints are valid teachers/baselines, the entropy-model rate is accurate, the training recipe matches compressAI, and single-seed Kodak averages suffice for curve comparison. The last two are the most fragile because they affect every comparison in the paper.

free parameters (3)
  • KD loss weights lambda1, lambda2, lambda3 (lambda4 in Eq. 2) = (0.2, 0.2, 0.4) default; sweep (0.1, 0.1, 0.8), (0.3, 0.3, 0.4), (0.4, 0.4, 0.2)
    Hand-chosen; the best balance (0.3, 0.3, 0.4) was selected by inspecting Kodak RD curves with no held-out validation protocol described (Section 5.1.2).
  • RD Lagrange multiplier lambda = 0.0018 to 0.18 (CompressAI quality 1-5 table)
    Inherited from CompressAI pre-trained quality settings; sets the operating points for all RD comparisons. An input from prior literature, not fitted by this paper, but it determines every reported operating point.
  • Number of channels N = 16, 32, 64, 96, 112
    Architectural design choice, the paper's main controlled axis. Recommending 64 channels is a hand-made tradeoff decision based on observed RD-resource curves (Section 5.2).
axioms (5)
  • domain assumption Knowledge distillation transfers generalization: a student trained on a teacher's outputs generalizes better than one trained alone (Hinton et al. [8]).
    Foundational premise for why the experiments should work; invoked in Sections 2.2 and 3.
  • domain assumption The compressAI scale-hyperprior checkpoints are valid teacher models and fair baselines for the reported comparisons.
    Used as teachers and as the comparison set in Section 5.1; any deficiency in the pre-trained models propagates to the conclusions.
  • domain assumption The entropy model's negative log-likelihood (Eq. 3) gives an accurate estimate of the true coding rate for both teacher and students.
    The training loss and reported BPP rest on this standard LIC approximation (Section 4.2).
  • domain assumption The training recipe (Vimeo90K patches, 4-5M steps, batch 16, LR 1e-4 with plateau decay) reproduces CompressAI training conditions closely enough for fair comparison.
    Section 4.2 states the recipe is matched to CompressAI documentation; if the recipe differs, the RD comparisons are confounded.
  • domain assumption PSNR/BPP averaged over the 24 Kodak images from a single training run per configuration are sufficient to compare RD curves.
    All principal conclusions are drawn from these curves (Figures 2-8); no error bars or repeated seeds are reported.

reviewed 2026-08-04 · how reviews work

0 comments
Cite this review

Pith. "Pith review of Efficient Learned Image Compression Through Knowledge Distillation." pith.science (2026). https://pith.science/paper/UZNRNYMT

@misc{pith2026250910366,
  author       = {Pith},
  title        = {Pith review of: Efficient Learned Image Compression Through Knowledge Distillation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/UZNRNYMT}},
  note         = {Machine review of arXiv:2509.10366}
}
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Learned image compression sits at the intersection of machine learning and image processing. With advances in deep learning, neural network-based compression methods have emerged. In this process, an encoder maps the image to a low-dimensional latent space, which is then quantized, entropy-coded into a binary bitstream, and transmitted to the receiver. At the receiver end, the bitstream is entropy-decoded, and a decoder reconstructs an approximation of the original image. Recent research suggests that these models consistently outperform conventional codecs. However, they require significant processing power, making them unsuitable for real-time use on resource-constrained platforms, which hinders their deployment in mainstream applications. This study aims to reduce the resource requirements of neural networks used for image compression by leveraging knowledge distillation, a training paradigm where smaller neural networks, partially trained on the outputs of larger, more complex models, can achieve better performance than when trained independently. Our work demonstrates that knowledge distillation can be effectively applied to image compression tasks: i) across various architecture sizes, ii) to achieve different image quality/bit rate tradeoffs, and iii) to save processing and energy resources. This approach introduces new settings and hyperparameters, and future research could explore the impact of different teacher models, as well as alternative loss functions. Knowledge distillation could also be extended to transformer-based models. The code is publicly available at: https://github.com/FABallemand/PRIM .

Figures

Figures reproduced from arXiv: 2509.10366 by Alaa Eddine Mazouz, Attilio Fiandrotti, Fabien Allemand, Sumanta Chaudhuri.

Figure 1
Figure 1. Figure 1: Representations of the scale hyperprior model. (Figures from [3]) [PITH_FULL_IMAGE:figures/full_fig_p005_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Average RD curve on the Kodak dataset for students with different number of channels. Despite being trained [PITH_FULL_IMAGE:figures/full_fig_p007_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Evaluation on the Kodak dataset of the scale hyperprior student models trained for image compression. [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figure 4
Figure 4. Figure 4: Average RD curve on the Kodak dataset for students with different RD tradeoffs. Trained by a teacher with an [PITH_FULL_IMAGE:figures/full_fig_p008_4.png] view at source ↗
Figure 5
Figure 5. Figure 5: Average RD curve on the Kodak dataset for students with different RD tradeoffs and a teacher focusing on [PITH_FULL_IMAGE:figures/full_fig_p008_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: Average RD on the Kodak dataset for students with different KD tradeoffs. Hyper-parameters in the loss [PITH_FULL_IMAGE:figures/full_fig_p009_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: Average RD on the Kodak dataset for students with KD on the hyper-latent space. Extending KD to the [PITH_FULL_IMAGE:figures/full_fig_p010_7.png] view at source ↗
Figure 8
Figure 8. Figure 8: Average RD on the Kodak dataset for students with KD on the hyper-latent space. Extending KD to the [PITH_FULL_IMAGE:figures/full_fig_p010_8.png] view at source ↗
Figure 9
Figure 9. Figure 9: PSNR and bit rate on the Kodak dataset according to students number of parameters. Reducing the number [PITH_FULL_IMAGE:figures/full_fig_p011_9.png] view at source ↗
Figure 10
Figure 10. Figure 10: PSNR and bit rate on the Kodak dataset according to students FLOPs. Our knowledge distilled models are [PITH_FULL_IMAGE:figures/full_fig_p012_10.png] view at source ↗
Figure 11
Figure 11. Figure 11: PSNR and bit rate on the Kodak dataset according to students throughput. All models, exceed standard [PITH_FULL_IMAGE:figures/full_fig_p012_11.png] view at source ↗
Figure 12
Figure 12. Figure 12: PSNR and bit rate on the Kodak dataset according to students consumed energy. KD is a great method to [PITH_FULL_IMAGE:figures/full_fig_p012_12.png] view at source ↗
Figure 13
Figure 13. Figure 13: Reconstruction results on image 14 of the Kodak dataset for different RD tradeoffs (pre-trained models). [PITH_FULL_IMAGE:figures/full_fig_p016_13.png] view at source ↗
Figure 14
Figure 14. Figure 14: Average RD curve on the Kodak dataset for students with different number of channels and Kullback-Leibler [PITH_FULL_IMAGE:figures/full_fig_p016_14.png] view at source ↗
Figure 15
Figure 15. Figure 15: Reconstruction results on image 14 of the Kodak dataset for image compression with different architectures [PITH_FULL_IMAGE:figures/full_fig_p017_15.png] view at source ↗
Figure 16
Figure 16. Figure 16: Average RD on the Kodak dataset for student with hybrid KD. [PITH_FULL_IMAGE:figures/full_fig_p018_16.png] view at source ↗
Figure 17
Figure 17. Figure 17: PSNR and bit rate on the Kodak dataset according to students memory footprint. [PITH_FULL_IMAGE:figures/full_fig_p018_17.png] view at source ↗
Figure 18
Figure 18. Figure 18: PSNR and bit rate on the Kodak dataset according to students inference time. [PITH_FULL_IMAGE:figures/full_fig_p018_18.png] view at source ↗
Figure 19
Figure 19. Figure 19: Average RD curve on the Kodak dataset for students with different number of channels and codecs. [PITH_FULL_IMAGE:figures/full_fig_p019_19.png] view at source ↗
Figure 20
Figure 20. Figure 20: PSNR and bit rate on the Kodak dataset according to students and codecs throughput. [PITH_FULL_IMAGE:figures/full_fig_p019_20.png] view at source ↗
Figure 21
Figure 21. Figure 21: PSNR and bit rate on the Kodak dataset according to students and codecs consumed energy. [PITH_FULL_IMAGE:figures/full_fig_p019_21.png] view at source ↗

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. KD-NVC: A Search-and-Distill Framework to Accelerate Neural Video Coding

    eess.IV 2026-06 unverdicted novelty 5.0

    KD-NVC combines acceleration-efficiency neural architecture search with energy-aware feature distillation to produce neural video codecs that reach 69 FPS 1080p decoding on RTX 5060 while matching VTM-LDB rate-distort...

Reference graph

Works this paper leans on

21 extracted references · 14 linked inside Pith · cited by 1 Pith paper

  1. [1]

    Simoncelli.End-to-end optimization of nonlinear transform codes for perceptual quality

    Johannes Ballé, Valero Laparra, and Eero P. Simoncelli.End-to-end optimization of nonlinear transform codes for perceptual quality. 2016. arXiv: 1607.05006 [cs.IT]. URL: https://arxiv.org/abs/1607.05006

  2. [2]

    Simoncelli.End-to-end Optimized Image Compression

    Johannes Ballé, Valero Laparra, and Eero P. Simoncelli.End-to-end Optimized Image Compression. 2017. arXiv: 1611.01704 [cs.CV]. URL: https://arxiv.org/abs/1611.01704

  3. [3]

    Variational image compression with a scale hyperprior

    Johannes Ballé et al. Variational image compression with a scale hyperprior . 2018. arXiv: 1802 . 01436 [eess.IV]. URL: https://arxiv.org/abs/1802.01436

  4. [4]

    Martini, and Yuriy Reznik

    Nabajeet Barman, Maria G. Martini, and Yuriy Reznik. Bjøntegaard Delta (BD): A Tutorial Overview of the Metric, Evolution, Challenges, and Recommendations . 2024. arXiv: 2401 . 04039 [cs.MM]. URL: https : //arxiv.org/abs/2401.04039

  5. [5]

    Image compression

    compressAI. Image compression. URL: https://interdigitalinc.github.io/CompressAI/zoo.html# training. (consulté: 30/01/2025)

  6. [6]

    Haisheng Fu et al.Fast and High-Performance Learned Image Compression With Improved Checkerboard Context Model, Deformable Residual Module, and Knowledge Distillation. 2023. arXiv: 2309.02529 [eess.IV]. URL: https://arxiv.org/abs/2309.02529

  7. [7]

    Microdosing: Knowledge Distillation for GAN-based Compression

    Leonhard Helminger et al. Microdosing: Knowledge Distillation for GAN-based Compression. 2022. arXiv: 2201.02624 [eess.IV]. URL: https://arxiv.org/abs/2201.02624

  8. [8]

    Distilling the Knowledge in a Neural Network

    Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. Distilling the Knowledge in a Neural Network . 2015. arXiv: 1503.02531 [stat.ML]. URL: https://arxiv.org/abs/1503.02531

  9. [9]

    FPX-NIC: An FPGA-Accelerated 4K Ultra-High-Definition Neural Video Coding System

    Chuanmin Jia et al. “FPX-NIC: An FPGA-Accelerated 4K Ultra-High-Definition Neural Video Coding System”. In: IEEE Transactions on Circuits and Systems for Video Technology 32.9 (2022), pp. 6385–6399. DOI: 10. 1109/TCSVT.2022.3164059

  10. [10]

    Cross-Architecture Knowledge Distillation

    Yufan Liu et al. Cross-Architecture Knowledge Distillation. 2022. arXiv: 2207.05273 [cs.CV]. URL: https: //arxiv.org/abs/2207.05273

  11. [11]

    Neural/Learned Image Compression: An Overview

    loijilai. Neural/Learned Image Compression: An Overview. URL: https://medium.com/@loijilai_me/ learned-image-compression-an-overview-625f3ab709f2 . (consulté: 30/01/2025)

  12. [12]

    Lightweight Embedded FPGA Deployment of Learned Image Compression with Knowledge Distillation and Hybrid Quantization

    Alaa Mazouz et al. “Lightweight Embedded FPGA Deployment of Learned Image Compression with Knowledge Distillation and Hybrid Quantization”. In: arXiv preprint arXiv:2503.04832 (2025)

  13. [13]

    Security and real-time fpga integration for learned image compression

    Alaa Mazouz et al. “Security and real-time fpga integration for learned image compression”. In: arXiv preprint arXiv:2503.04867 (2025)

  14. [14]

    Joint Autoregressive and Hierarchical Priors for Learned Image Compression

    David Minnen, Johannes Ballé, and George Toderici. Joint Autoregressive and Hierarchical Priors for Learned Image Compression. 2018. arXiv: 1809.02736 [cs.CV]. URL: https://arxiv.org/abs/1809.02736. 14

  15. [15]

    David Minnen and Saurabh Singh.Channel-wise Autoregressive Entropy Models for Learned Image Compression

  16. [16]

    Stanford EE274: Data Compression I 2023 I Lecture 16 - Learnt Image Compression

    Stanford Online. Stanford EE274: Data Compression I 2023 I Lecture 16 - Learnt Image Compression. URL: https : / / www . youtube . com / watch ? v = H7dvh35xNuE & ab _ channel = StanfordOnline. (consulté: 30/01/2025)

  17. [17]

    FPGA Codec System of Learned Image Compression With Algorithm-Architecture Co-Optimization

    Heming Sun, Qingyang Yi, and Masahiro Fujita. “FPGA Codec System of Learned Image Compression With Algorithm-Architecture Co-Optimization”. In: IEEE Journal on Emerging and Selected Topics in Circuits and Systems 14.2 (2024), pp. 334–347. DOI: 10.1109/JETCAS.2024.3386328

  18. [18]

    FPGA Codec System of Learned Image Compression with Algorithm-Architecture Co-Optimization

    Heming Sun, Qingyang Yi, and Masahiro Fujita. “FPGA Codec System of Learned Image Compression with Algorithm-Architecture Co-Optimization”. In: IEEE Journal on Emerging and Selected Topics in Circuits and Systems (2024)

  19. [19]

    Training data-efficient image transformers & distillation through attention

    Hugo Touvron et al. Training data-efficient image transformers & distillation through attention. 2021. arXiv: 2012.12877 [cs.CV]. URL: https://arxiv.org/abs/2012.12877

  20. [20]

    The Devil Is in the Details: Window-based Attention for Image Compression

    Renjie Zou, Chunfeng Song, and Zhaoxiang Zhang. The Devil Is in the Details: Window-based Attention for Image Compression. 2022. arXiv: 2203.08450 [eess.IV]. URL: https://arxiv.org/abs/2203.08450. A Reproducibility A.1 Implementation Details All experiments are conducted using Python 3.12.7 and the version 1.2.6 of compressAI (see requirements file for ot...

  21. [2020]

    URL: https://arxiv.org/abs/2007.08739

    arXiv: 2007.08739 [eess.IV]. URL: https://arxiv.org/abs/2007.08739

This paper was first reviewed by deepseek-v4-flash on August 4, 2026.