Pith. sign in

REVIEW 2 major objections 2 minor 38 references

Exploiting In-Sensor Computing for Energy-Efficient Earth Observation

T0 review · 2 major / 2 minor · reviewed 2026-06-28 · grok-4.3

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read In-sensor computing on the IMX500 vision sensor processes Earth observation images at 96.68 percent accuracy while fitting inside 8 MB and using 14.19 mJ per inference.

desk verdict The paper supplies IMX500-specific energy and latency numbers on EuroSAT but does not test downlink reduction or orbital conditions. read the letter →

arxiv 2606.01271 v1 pith:DVPBKDDE submitted 2026-05-31 cs.CV

Luigi Capogrosso , Pietro Bonazzi , Loris Hoxhaj , Michele Magno This is my paper
classification cs.CV
keywords in-sensorcomputingTinyMLEarthobservationIMX500energyefficiencysatellitedataconvolutionalneuralnetworksEuroSAT
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper establishes that shifting convolutional neural network inference directly onto the sensor chip can address the mismatch between massive satellite data collection and limited downlink bandwidth. It adapts several efficient models to the Sony IMX500 platform and reports that they still reach 96.68 percent accuracy on land-cover classification after the necessary memory and quantization changes. The resulting system runs at 17.40 frames per second with low latency and energy draw, moving the first stage of filtering away from the main onboard computer. Readers would care because satellites currently transmit large amounts of low-value imagery; early rejection at the sensor could free bandwidth and power for more useful observations.

What carries the argument

The in-sensor computing framework that places optimized ConvNet inference directly on the IMX500 sensor to perform early filtering before data reaches the main processor.

What would settle it

Evaluating the deployed models on a set of actual orbital satellite images and measuring whether accuracy stays near 96.68 percent and energy stays near 14.19 mJ, or attempting full hardware integration and checking for thermal or radiation failures.

Watch

Extended reading notes

Core claim

The central claim is that an end-to-end Earth Observation pipeline built by combining TinyML techniques with the Sony IMX500 Intelligent Vision Sensor maintains 96.68 percent accuracy on the EuroSAT dataset while respecting the sensor's 8 MB memory limit, delivering 17.40 FPS throughput, 27.43 ms latency, 14.19 mJ energy per inference, and 42.26 GMAC/J efficiency, thereby showing that in-sensor processing can offload the primary embedded device and reduce transmission of noisy or irrelevant data.

Load-bearing premise

That performance measured on the EuroSAT dataset after platform-specific optimizations will translate to real orbital imagery without extra thermal, radiation, or power constraints from actual satellite integration.

Editorial extensions

If this is right

  • Computation is offloaded from the primary embedded device to the sensor itself.
  • Transmission of noisy or irrelevant data over limited downlink bandwidth is reduced.
  • Energy efficiency reaches 42.26 GMAC/J, making the approach viable under satellite power budgets.
  • Standard efficient models remain usable after the memory and quantization steps required by the 8 MB platform limit.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the energy numbers hold under flight conditions, similar sensor-level filtering could be applied to other remote-sensing tasks such as change detection or anomaly spotting.
  • The same approach might reduce the required size or power of the main onboard computer in future satellite designs.
  • Extending the method to multi-spectral or higher-resolution sensors would require repeating the quantization and memory-mapping steps for each new hardware target.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 2 minor

Summary. The manuscript introduces an in-sensor computing framework for Earth Observation that integrates TinyML-optimized ConvNets (SqueezeNet, ShuffleNetV2, MCUNetV1) with the Sony IMX500 sensor. Processing is shifted to the sensor to offload the primary embedded device and reduce downlink of noisy or irrelevant data. On the EuroSAT land-cover classification task the optimized models achieve 96.68% accuracy while fitting within the sensor's 8 MB limit, delivering 17.40 FPS average throughput, 27.43 ms latency, 14.19 mJ per inference, and 42.26 GMAC/J efficiency.

Significance. If the reported hardware metrics generalize beyond EuroSAT, the work would supply concrete, directly measured evidence that in-sensor inference is feasible under tight memory and energy budgets typical of satellite payloads. The absence of fitted parameters or circular reductions in the evaluation strengthens the empirical grounding. The primary value lies in the platform-specific optimization results rather than in any demonstrated end-to-end downlink savings.

major comments (2)
  1. [Abstract] Abstract: the claim that the framework 'effectively mitigating the downlink transmission of noisy or irrelevant data' is unsupported by any experiment; the evaluation consists solely of EuroSAT classification accuracy and IMX500 platform metrics with no measurement of frame filtering, downlink volume reduction, or robustness to orbital degradations.
  2. [Experimental results paragraph] Experimental results paragraph: the headline 96.68% accuracy is presented without error bars, ablation results on the platform-specific optimizations, or explicit confirmation that post-optimization accuracy was measured on held-out data, weakening the assertion of competitive performance under the stated constraints.
minor comments (2)
  1. A diagram clarifying the placement of in-sensor processing relative to the satellite OBC and downlink path would improve readability of the proposed pipeline.
  2. [Abstract] The abstract should state which model attains the 96.68% figure and whether this is the best or an average across the three networks.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the constructive comments. We address each major point below and will revise the manuscript accordingly where the concerns are valid.

read point-by-point responses

  1. Referee: [Abstract] Abstract: the claim that the framework 'effectively mitigating the downlink transmission of noisy or irrelevant data' is unsupported by any experiment; the evaluation consists solely of EuroSAT classification accuracy and IMX500 platform metrics with no measurement of frame filtering, downlink volume reduction, or robustness to orbital degradations.

    Authors: We agree the claim is unsupported by direct experiments in this work. The evaluation demonstrates in-sensor inference feasibility on EuroSAT but does not measure downlink savings or orbital robustness. We will revise the abstract to remove the unsupported phrasing and instead note that in-sensor processing conceptually enables selective data handling, with end-to-end downlink evaluation identified as future work. revision: yes

  2. Referee: [Experimental results paragraph] Experimental results paragraph: the headline 96.68% accuracy is presented without error bars, ablation results on the platform-specific optimizations, or explicit confirmation that post-optimization accuracy was measured on held-out data, weakening the assertion of competitive performance under the stated constraints.

    Authors: The 96.68% figure is the post-optimization accuracy on the standard held-out EuroSAT test split. We will add error bars from repeated training runs with varied seeds, include an ablation table quantifying accuracy impact of each optimization step (quantization, memory fitting), and explicitly state the test-set evaluation protocol in the revised results section. revision: yes

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: purely empirical measurements with no derivation chain

full rationale

The paper reports direct hardware measurements (accuracy 96.68%, 17.40 FPS, 27.43 ms latency, 14.19 mJ/inference) of pre-existing ConvNets (SqueezeNet, ShuffleNetV2, MCUNetV1) after platform-specific optimizations on the public EuroSAT dataset. No equations, fitted parameters, predictions, or first-principles derivations appear in the provided text. No self-citations are invoked to justify uniqueness or load-bearing premises. The central claims rest on experimental results rather than any reduction to inputs by construction. This matches the reader's assessment of score 1.0 and contains none of the enumerated circularity patterns.

Assumptions & free parameters 0 free parameters · 0 assumptions · 0 invented entities

Work is purely empirical; no mathematical derivation, new constants, or postulated entities are introduced. Model selection and platform constraints are the only implicit choices.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Exploiting In-Sensor Computing for Energy-Efficient Earth Observation." pith.science (2026). https://pith.science/paper/DVPBKDDE

@misc{pith2026260601271,
  author       = {Pith},
  title        = {Pith review of: Exploiting In-Sensor Computing for Energy-Efficient Earth Observation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/DVPBKDDE}},
  note         = {Machine review of arXiv:2606.01271}
}
read the original abstract

The rapid growth of the satellite industry has driven a significant increase in geospatial data acquisition, highlighting a critical bottleneck: the severe disparity between the volume of collected sensor data and the limited downlink bandwidth available to ground stations. While On-Board Computing (OBC) has helped address this by pre-processing data in orbit, this article further advances the paradigm by introducing an in-sensor computing framework. We present an optimized end-to-end Earth Observation (EO) pipeline tailored for strict computational constraints by integrating TinyML techniques with the Sony IMX500 Intelligent Vision Sensor. Specifically, our approach shifts processing directly to the sensor level, offloading the computation from the primary embedded device, and effectively mitigating the downlink transmission of noisy or irrelevant data. We evaluated several efficient Convolutional Neural Networks (ConvNets), i.e., SqueezeNet, ShuffleNetV2, and MCUNetV1, on the EuroSAT dataset. Experimental results show that, despite the optimizations required for deployment on the IMX500 platform, our models maintain a competitive 96.68% accuracy while operating within its 8 MB constraints. Specifically, the models reach an average processing throughput of 17.40 FPS with a latency of 27.43 ms. Furthermore, our system profile exhibits high energy efficiency, with a low energy footprint of 14.19 mJ per inference and an efficiency rating of 42.26 GMAC/J, demonstrating its viability for in-sensor deployment.

Figures

Figures reproduced from arXiv: 2606.01271 by the authors.

Figure 1
Figure 1. [PITH_FULL_IMAGE:figures/full_fig_p006_1.png] view at source ↗

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

38 extracted references · 4 canonical work pages

  1. [1]

    Telecommunication Systems for Small Satellites Operating at High Frequencies: A Review.Information, 11(5):258, 2020

    Alessandra Babuscia. Telecommunication Systems for Small Satellites Operating at High Frequencies: A Review.Information, 11(5):258, 2020

    2020

  2. [2]

    PicoSAM2: Low-Latency Segmentation In-Sensor for Edge Vision Appli- cations.IEEE Sensors Conference, 2025

    Pietro Bonazzi, Nicola Farronato, Stefan Zihlmann, Haotong Qin, and Michele Magno. PicoSAM2: Low-Latency Segmentation In-Sensor for Edge Vision Appli- cations.IEEE Sensors Conference, 2025

    2025

  3. [3]

    PicoSAM3: Real-Time In-Sensor Region-of-Interest Segmentation

    Pietro Bonazzi, Nicola Farronato, Stefan Zihlmann, Haotong Qin, and Michele Magno. PicoSAM3: Real-Time In-Sensor Region-of-Interest Segmentation.arXiv preprint arXiv:2603.11917, 2026

    work page Pith review arXiv 2026

  4. [4]

    Tiny- Tracker: Ultra-Fast and Ultra-Low-Power Edge Vision In-Sensor for Gaze Estima- tion.IEEE Sensors, 2023

    Pietro Bonazzi, Thomas R¨ uegg, Sizhen Bian, Yawei Li, and Michele Magno. Tiny- Tracker: Ultra-Fast and Ultra-Low-Power Edge Vision In-Sensor for Gaze Estima- tion.IEEE Sensors, 2023

    2023

  5. [5]

    TinyGLASS: Real-Time Self-Supervised In-Sensor Anomaly Detection,

    Pietro Bonazzi, Rafael Sutter, Luigi Capogrosso, Mischa Buob, and Michele Magno. TinyGLASS: Real-Time Self-Supervised In-Sensor Anomaly Detection. arXiv preprint arXiv:2603.16451, 2026

    work page Pith review arXiv 2026

  6. [6]

    The CubeSat mission FUTURE: A preliminary analysis to validate the on-board autonomous orbit determination

    Carmine Buonagura, Salvatore Borgia, Mattia Pugliatti, Alessandro Morselli, Francesco Topputo, Filippo Corradino, Pierluigi Visconti, Luca Deva, Alberto Fedele, Giuseppe Leccese, et al. The CubeSat mission FUTURE: A preliminary analysis to validate the on-board autonomous orbit determination. In12th Inter- national Conference on Guidance, Navigation & Con...

    2023

  7. [7]

    Performance Analysis of Edge and In-Sensor AI Processors: A Comparative Review.arXiv preprint arXiv:2603.08725, 2026

    Luigi Capogrosso, Pietro Bonazzi, and Michele Magno. Performance Analysis of Edge and In-Sensor AI Processors: A Comparative Review.arXiv preprint arXiv:2603.08725, 2026

    work page arXiv 2026

  8. [8]

    A Machine Learning-Oriented Survey on Tiny Machine Learning.IEEE Access, 12:23406–23426, 2024

    Luigi Capogrosso, Federico Cunico, Dong Seon Cheng, Franco Fummi, and Marco Cristani. A Machine Learning-Oriented Survey on Tiny Machine Learning.IEEE Access, 12:23406–23426, 2024

    2024

Show all 38 references
  1. [9]

    TinyML Enhances CubeSat Mission Capa- bilities.arXiv preprint arXiv:2603.20174, 2026

    Luigi Capogrosso and Michele Magno. TinyML Enhances CubeSat Mission Capa- bilities.arXiv preprint arXiv:2603.20174, 2026

    2026

  2. [10]

    Opportunities and challenges of on-board AI-based image recognition for small satellite Earth observation missions.Advances in Space Re- search, 75(9):6734–6751, 2025

    Bharadwaj Chintalapati, Arthur Precht, Sougata Hanra, Rene Laufer, Marcus Li- wicki, and Jens Eickhoff. Opportunities and challenges of on-board AI-based image recognition for small satellite Earth observation missions.Advances in Space Re- search, 75(9):6734–6751, 2025. Explo...

    2025

  3. [11]

    Crisp, P.C.E

    N.H. Crisp, P.C.E. Roberts, S. Livadiotti, V.T.A. Oiko, S. Edmondson, S.J. Haigh, C. Huyton, L.A. Sinpetru, K.L. Smith, S.D. Worrall, J. Becedas, R.M. Dom´ ınguez, D. Gonz´ alez, V. Hanessian, A. Mølgaard, J. Nielsen, M. Bisgaard, Y.- A. Chan, S. Fasoulas, G.H. Herdrich, F. Ro...

    2020

  4. [12]

    Mmitigating challenges of the space environment for onboard artificial intelligence: Design overview of the imaging payload on spirit

    Miguel Ortiz Del Castillo, Jonathan Morgan, Jack McRobbie, Clint Therakam, Zaher Joukhadar, Robert Mearns, Simon Barraclough, Richard Sinnott, Andrew Woods, Chris Bayliss, et al. Mmitigating challenges of the space environment for onboard artificial intelligence: Design overvi...

    2024

  5. [13]

    Review on Hardware Devices and Software Techniques Enabling Neural Network Inference Onboard Satellites.Remote Sens- ing, 16(21):3957, 2024

    Lorenzo Diana and Pierpaolo Dini. Review on Hardware Devices and Software Techniques Enabling Neural Network Inference Onboard Satellites.Remote Sens- ing, 16(21):3957, 2024

    2024

  6. [14]

    Earth+: On-Board Satellite Imagery Compression Leveraging Historical Earth Ob- servations

    Kuntai Du, Yihua Cheng, Peder Olsen, Shadi Noghabi, and Junchen Jiang. Earth+: On-Board Satellite Imagery Compression Leveraging Historical Earth Ob- servations. In30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2025

    2025

  7. [15]

    Advancing Earth observation: a survey on AI-powered image processing in satellites.European Journal of Remote Sensing, 58(1), 2025

    Aidan Duggan, Bruno Andrade, and Haithem Afli. Advancing Earth observation: a survey on AI-powered image processing in satellites.European Journal of Remote Sensing, 58(1), 2025

    2025

  8. [16]

    9.6 A 1/2.3inch 12.3Mpixel with On-Chip 4.97TOPS/W CNN Processor Back-Illuminated Stacked CMOS Image Sensor

    Ryoji Eki, Satoshi Yamada, Hiroyuki Ozawa, Hitoshi Kai, Kazuyuki Okuike, Ha- reesh Gowtham, Hidetomo Nakanishi, Edan Almog, Yoel Livne, Gadi Yuval, Eli Zyss, and Takashi Izawa. 9.6 A 1/2.3inch 12.3Mpixel with On-Chip 4.97TOPS/W CNN Processor Back-Illuminated Stacked CMOS Image...

    2021

  9. [17]

    Artificial intelligence for satellite com- munication: A review.Intelligent and Converged Networks, 2(3):213–243, 2021

    Fares Fourati and Mohamed-Slim Alouini. Artificial intelligence for satellite com- munication: A review.Intelligent and Converged Networks, 2(3):213–243, 2021

    2021

  10. [18]

    Convolutional Neural Networks for On-Board Cloud Screening.Remote Sensing, 11(12):1417, 2019

    Sina Ghassemi and Enrico Magli. Convolutional Neural Networks for On-Board Cloud Screening.Remote Sensing, 11(12):1417, 2019

    2019

  11. [19]

    CloudScout: A Deep Neural Net- work for On-Board Cloud Detection on Hyperspectral Images.Remote Sensing, 12(14):2205, 2020

    Gianluca Giuffrida, Lorenzo Diana, Francesco de Gioia, Gionata Benelli, Gabriele Meoni, Massimiliano Donati, and Luca Fanucci. CloudScout: A Deep Neural Net- work for On-Board Cloud Detection on Hyperspectral Images.Remote Sensing, 12(14):2205, 2020

    2020

  12. [20]

    The Phi-Sat-1 Mission: The First On-Board Deep Neural Network Demonstrator for Satellite Earth Observation.IEEE Transactions on Geoscience and Remote Sensing, 60:1– 14, 2022

    Gianluca Giuffrida, Luca Fanucci, Gabriele Meoni, Matej Batic, Leonie Buckley, Aubrey Dunne, Chris van Dijk, Marco Esposito, John Hefele, Nathan Vercruyssen, Gianluca Furano, Massimiliano Pastena, and Josef Aschbacher. The Phi-Sat-1 Mission: The First On-Board Deep Neural Netw...

    2022

  13. [21]

    On-Board Image Com- pression using Convolutional Autoencoder: Performance Analysis and Application Scenarios

    Giorgia Guerrisi, Giovanni Schiavon, and Fabio Del Frate. On-Board Image Com- pression using Convolutional Autoencoder: Performance Analysis and Application Scenarios. InIEEE International Geoscience and Remote Sensing Symposium (IGARSS), 2023

    2023

  14. [22]

    Patrick Helber, Benjamin Bischke, Andreas Dengel, and Damian Borth. EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification.IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12(7):2217–2226, 2019. 10 L. Ca...

    2019

  15. [23]

    SqueezeNet: AlexNet-level accuracy with 50x fewer pa- rameters and ¡ 0.5 MB model size

    Forrest N Iandola, Song Han, Matthew W Moskewicz, Khalid Ashraf, William J Dally, and Kurt Keutzer. SqueezeNet: AlexNet-level accuracy with 50x fewer pa- rameters and ¡ 0.5 MB model size. InInternational Conference on Learning Rep- resentations (ICLR), 2017

    2017

  16. [24]

    Adam: A Method for Stochastic Optimization

    Diederik P Kingma and Jimmy Ba. Adam: A Method for Stochastic Optimization. InInternational Conference for Learning Representations (ICLR), 2015

    2015

  17. [25]

    Vu, and George Goussetis

    Oltjon Kodheli, Eva Lagunas, Nicola Maturo, Shree Krishna Sharma, Bhavani Shankar, Jesus Fabian Mendoza Montoya, Juan Carlos Merlano Duncan, Danilo Spano, Symeon Chatzinotas, Steven Kisseleff, Jorge Querol, Lei Lei, Thang X. Vu, and George Goussetis. Satellite Communications i...

    2021

  18. [26]

    Satellite Edge Com- puting for Real-Time and Very-High Resolution Earth Observation.IEEE Trans- actions on Communications, 71(10):6180–6194, 2023

    Israel Leyva-Mayorga, Marc Martinez-Gost, Marco Moretti, Ana P´ erez-Neira, Miguel ´Angel V´ azquez, Petar Popovski, and Beatriz Soret. Satellite Edge Com- puting for Real-Time and Very-High Resolution Earth Observation.IEEE Trans- actions on Communications, 71(10):6180–6194, 2023

    2023

  19. [27]

    Douglas Liddle, Antony P

    J. Douglas Liddle, Antony P. Holt, Susan J. Jason, Kathryn A. O’Donnell, and Edward J. Stevens. Space science with CubeSats and nanosatellites.Nature As- tronomy, 4(11):1026–1030, 2020

    2020

  20. [28]

    MCUNet: Tiny Deep Learning on IoT Devices

    Ji Lin et al. MCUNet: Tiny Deep Learning on IoT Devices. InAdvances in Neural Information Processing Systems (NeurIPS), 2020

    2020

  21. [29]

    Machine Learning in Earth Observation Operations: A review

    Pablo Miralles, Antonio Fulvio Scannapieco, Nitya Jagadam, Prerna Baranwal, Bhavin Faldu, Ruchita Abhang, Sahil Bhatia, Sebastien Bonnart, Ishita Bhatnagar, Beenish Batul, et al. Machine Learning in Earth Observation Operations: A review. In72nd International Astronautical Con...

    2021

  22. [30]

    Hardware platforms enabling edge ai for space applications: A critical review.IEEE Access, 13:143939–143956, 2025

    Gabriela Mystkowska, Matteo Monopoli, Pietro Nannipieri, Luca Zulberti, David Merodio Codinachs, and Luca Fanucci. Hardware platforms enabling edge ai for space applications: A critical review.IEEE Access, 13:143939–143956, 2025

    2025

  23. [31]

    Earth Observing System Data and Information System (EOSDIS) Handbook, 2018

    National Aeronautics and Space Administration (NASA). Earth Observing System Data and Information System (EOSDIS) Handbook, 2018. Accessed: 2025-10-25

    2018

  24. [32]

    PyTorch: An Imperative Style, High-Performance Deep Learn- ing Library

    Adam Paszke et al. PyTorch: An Imperative Style, High-Performance Deep Learn- ing Library. InAdvances in Neural Information Processing Systems (NeurIPS), 2019

    2019

  25. [33]

    The Raspberry Pi AI Camera

    Raspberry Pi Documentation. The Raspberry Pi AI Camera. https://www.raspberrypi.com/documentation/accessories/ai-camera.html. Ac- cessed: 2026-03-05

    2026

  26. [34]

    Sony Semiconductor Solutions. IMX500. https://developer.sony.com/imx500. Ac- cessed: 2026-03-30

    2026

  27. [35]

    Model Compression Toolkit (MCT)

    Sony Semiconductor Solutions. Model Compression Toolkit (MCT). https://github.com/SonySemiconductorSolutions/mct-model-optimization. Ac- cessed: 2026-03-05

    2026

  28. [36]

    High-Performance On-Orbit Intelligent Computing and Real-Time Services for Remote Sensing Satellites Based on Large-Scale Computing Power in Space

    Guoping Wang, Gang Wan, Zhijuan Su, Yang Wang, Yutong Jia, Gong Li, and Shi Liang. High-Performance On-Orbit Intelligent Computing and Real-Time Services for Remote Sensing Satellites Based on Large-Scale Computing Power in Space. IEEE Access, 13:92114–92133, 2025

    2025

  29. [37]

    ShuffleNet: An Ex- tremely Efficient Convolutional Neural Network for Mobile Devices

    Xiangyu Zhang, Xinyu Zhou, Mengxiao Lin, and Jian Sun. ShuffleNet: An Ex- tremely Efficient Convolutional Neural Network for Mobile Devices. InProceedings of the IEEE conference on computer vision and pattern recognition, 2018

    2018

  30. [38]

    Expandable On-Board Real-Time Edge Computing Architecture for Luojia3 Intel- ligent Remote Sensing Satellite.Remote Sensing, 14(15):3596, 2022

    Zhiqi Zhang, Zhuo Qu, Siyuan Liu, Dehua Li, Jinshan Cao, and Guangqi Xie. Expandable On-Board Real-Time Edge Computing Architecture for Luojia3 Intel- ligent Remote Sensing Satellite.Remote Sensing, 14(15):3596, 2022

    2022

Pith tools

Reviewed June 28, 2026 · model on record in the stance chip above.