Pith. sign in

REVIEW 3 major objections 6 minor 1 cited by

RGB-Event ISP: The Dataset and Benchmark

T0 review · 3 major / 6 minor · reviewed 2026-08-09 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This paper introduces the first dataset pairing RAW frames with pixel-aligned events for image signal processing, and uses it to benchmark learnable ISPs plus a simple event-fusion network.

desk verdict Useful first dataset and benchmark for event-guided ISP; the event-benefit result is suggestive, not established, because the reference is the authors' own ISP and the outdoor gain rests on three scenes. read the letter →

arxiv 2501.19129 v1 pith:T23P3C2B submitted 2025-01-31 cs.CV eess.IV

Yunfan Lu , Yanlin Qian , Ziyang Rao , Junren Xiao , Liming Chen , Hui Xiong This is my paper · ORCID
classification cs.CVeess.IV
keywords event-guidedISPhybridvisionsensorquad-BayerRAWeventcameradatasetimagesignalprocessorbenchmarkRAW-to-RGBfusion
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper's claim is that event-guided image signal processing deserves to be studied as its own problem, and that the community has lacked the data to do so. To supply that data, the authors present the first dataset pairing RAW images with pixel-aligned events, captured on a hybrid vision sensor that embeds event photodiodes inside a quad-Bayer color filter array. They generate reference RGB images with their own controllable ISP pipeline using a ColorChecker, benchmark existing learnable ISPs on it, and add a simple event-fusion baseline. The benchmark shows that fusing events into a UNet raises outdoor PSNR from 28.17 dB to 30.11 dB but hurts indoor scenes, which the authors attribute to flickering artificial lighting. If the dataset and reference pipeline hold up, this becomes the standard first resource and test bed for event-guided ISP research.

What carries the argument

The central object is the HVS-ISP dataset: 3373 RAW frames at 2248x3264 from the ALPIX-Eiger hybrid vision sensor, whose quad-Bayer pattern allocates one quarter of photodiodes to events and thereby yields pixel-level aligned event streams at half the RAW resolution. The controllable ISP pipeline—black-level and fixed-pattern subtraction, quad-Bayer demosaicing, ColorChecker-based white balance, BM3D denoising, color correction, and gamma—generates the reference RGB frames that define the benchmark task. The EV-UNet baseline, which feeds voxel-grid event encodings into a UNet encoder, is the probe that demonstrates events carry usable signal for outdoor RAW-to-RGB reconstruction.

What would settle it

Concrete test: take a held-out subset of outdoor scenes, produce reference RGB with an independent calibrated capture such as a high-end camera or a second ISP implementation, and re-run the UNet versus EV-UNet comparison; if the 1.94 dB outdoor gain shrinks or reverses, the reported event benefit is an artifact of the controllable ISP reference. A complementary test is to run EV-UNet on indoor scenes under DC, non-flickering illumination; if the indoor degradation persists, flicker is not the whole story.

Watch

Extended reading notes

Core claim

The paper's central claim is that event-guided ISP is a distinct problem with its own data requirements, and that no prior dataset satisfied them because existing event-RGB datasets assume a finished RGB image already exists, while the MIPI HVS RAW datasets omit real event streams. To fill this gap, the authors introduce the first event-RAW paired dataset, with 3373 quad-Bayer RAW images and pixel-aligned events spanning 24 scenes, three exposure modes, and three lenses, plus a controllable ColorChecker-based ISP that produces reference RGB frames. On this benchmark, their simple EV-UNet fusion raises outdoor PSNR from 28.17 dB to 30.11 dB against the no-event UNet and outperforms the event backbone eSL-Net, but it degrades indoors, which the paper attributes to AC-driven flicker in artificial lighting. The paper also documents that learning-based ISP methods are strongly scene-dependent and that local RAW neighborhoods do not uniquely determine output brightness, an ill-posedness that motivates event input.

Load-bearing premise

The ground-truth RGB images that every benchmark score is measured against are produced by the authors' own ColorChecker-guided ISP pipeline, with a mean color error of 5.84 CIEDE00, so any bias in that reference would propagate into all rankings and into the conclusion that events help outdoors.

Editorial extensions

If this is right

  • The HVS-ISP dataset provides the first standardized paired event-RAW benchmark, so future event-guided ISP methods can be compared on identical data and metrics.
  • Fusing events into a UNet encoder raises outdoor PSNR from 28.17 dB to 30.11 dB, indicating that event streams carry motion and dynamic-range information useful for RAW-to-RGB reconstruction outdoors.
  • Existing learnable ISPs are strongly scene-dependent, with PyNet leading outdoors at 32.47 dB average PSNR and UNet leading indoors at 31.76 dB, so single-scene or mixed-scene evaluations can mislead.
  • Indoor artificial lighting flicker from AC-driven LEDs corrupts event statistics at high event rates, and the paper identifies this as a key obstacle for event-guided ISP indoors.
  • Local RAW neighborhoods map non-injectively to output brightness, so brightness estimation in an ISP needs global context or event information; the paper visualizes this with a t-SNE-based 3D plot.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the dataset becomes the standard test bed, a natural next step is to use events not just as an extra encoder input but as a high-temporal-resolution prior to replace motion estimation modules inside the ISP, which the paper does not explore.
  • Because the sensor places events at one quarter of the quad-Bayer photodiodes, the dataset could be repurposed for cross-modal super-resolution or joint demosaicing that reconstructs full color at event resolution; this is an extension the authors do not claim.
  • A simple flicker-normalization front end, such as aggregating events over an AC half-cycle or estimating the flicker phase from event rates, could test whether the indoor failure is fundamentally about flicker or about the fusion architecture; the paper leaves this untested.
  • The reference pipeline's mean CIEDE00 error of 5.84 suggests that a future version with independent colorimetric ground truth could change absolute rankings even if relative comparisons between methods remain stable.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. This paper introduces the first event-RAW paired dataset for event-guided image signal processing (ISP), captured with a prototype hybrid-vision sensor (ALPIX-Eiger) that records pixel-aligned events and quad-Bayer RAW frames at 2248x3264. The dataset contains 3373 frames across 24 scenes, with ColorChecker annotations used by a proposed 'controllable ISP' pipeline to generate reference RGB images. The authors benchmark ten existing learning-based ISP methods plus a simple event-fusion baseline (EV-UNet) on indoor and outdoor test scenes, reporting that EV-UNet improves outdoor PSNR over UNet* (30.11 vs 28.17) while performing worse indoors. They also discuss challenges such as flickering artificial light and the ill-posedness of brightness estimation in ISP.

Significance. If validated, the dataset is a valuable community resource: it is the first public corpus with aligned RAW and event streams from a hybrid sensor, and the code and dataset are released. The benchmark is conducted in a consistent framework, and the simple EV-UNet baseline provides a first reference point for event-guided ISP. However, the reference ground truth is generated by the authors' own pipeline with moderate color error (CIEDE00 5.84), and the headline event-benefit result rests on three outdoor scenes without variance estimates. The dataset can still support future work even if the specific rankings are revised, but the benchmark's usefulness will depend on independent validation of the reference.

major comments (3)
  1. [Sec. 4.2, Fig. 5(a), Tables 3-4] The 'good RGB' reference used for training and evaluation is produced entirely by the authors' controllable ISP, which has a mean CIEDE00 error of 5.84 against ColorChecker values. Because every learned model, including EV-UNet, is trained to regress to this exact pipeline output, the PSNR/SSIM/L1 numbers in Tables 3 and 4 measure fidelity to that hand-built ISP rather than absolute image quality. The claimed event benefit (EV-UNet 30.11 vs UNet* 28.17 outdoor average PSNR in Table 3) is therefore entangled with reference-pipeline biases such as BM3D smoothing and a color-correction matrix fitted on the same ColorChecker patches used in the evaluation. The authors should demonstrate that the ranking and the event gain are stable when the reference is generated by an independent ISP or when the controllable ISP's hyperparameters (e.g., BM3D sigma, CCM, demosaicing method) are varied.
  2. [Sec. 5.2, Tables 3-4, Sec. 5.3] The conclusion that events improve outdoor ISP rests on a single comparison over three test scenes with no standard deviations, confidence intervals, or repeated training runs. Moreover, EV-UNet does not outperform UNet* consistently across those scenes: it is worse on 4-Out-Building-1 (24.59 vs 29.24) and the average gain is carried by 3-Out-Flower-2 (32.87 vs 25.75). The statement in Sec. 5.3 that 'the integration of events in our dataset significantly enhances performance in outdoor scenes' is too strong for this evidence. Report variance across training runs or train/test splits, and apply a paired significance test before drawing this conclusion.
  3. [Sec. 4.1, Sec. 4.2, Fig. 5] The white balance step and the 3x3 color correction matrix are both computed from the same 24 ColorChecker patch averages, and the evaluation in Fig. 5(a,b) is also performed on ColorChecker-inclusive frames. This makes the reported CIEDE00 and CIELAB errors in-sample fitting scores, not independent estimates of reference color accuracy. The paper should withhold a subset of ColorChecker patches or frames for evaluation, or use a separate color target, to give an unbiased estimate of how accurate the reference really is.
minor comments (6)
  1. [Abstract, Fig. 3] Typos: 'pipleline' in the abstract and 'Demosacing' in the Figure 3 heading should be corrected.
  2. [Sec. 5.2] The text attributes PyNet to '(Kim et al., 2020)', but PyNet originates from Ignatov et al. (2020b); Kim et al. (2020) proposed PyNetCA. Please fix the citation.
  3. [Tables 3-4] The meaning of the star notation (e.g., 'UNet*', 'PyNET*', 'CameraNet*') is not defined in the table captions or the legend; specify which hyperparameters differ from the base models.
  4. [Sec. 4.2, Fig. 5] Use consistent nomenclature: the standard abbreviation is CIEDE2000, and the second metric should be written as CIELAB Δab rather than 'CIEDE Lab Error'.
  5. [Tables 3-4] Since the averages are computed over only three scenes per table, report standard deviations alongside the averages to convey the variability across scenes.
  6. [Sec. 5.3] The 'Event Gains' paragraph should be qualified: the improvement over UNet* is not consistent across the three outdoor scenes (see major comment 2), so 'significantly enhances' overstates the evidence.

Circularity Check

1 steps flagged · score 3.0 of 10

Central benchmark and event-gain claims are empirical, but the color-accuracy validation of the self-generated reference is a fitted residual on the same ColorChecker objective used to compute the CCM.

  1. fitted input called prediction [Sec. 4.1 (5) Color Space transform; Sec. 4.2 Controllable ISP Evaluation, Fig. 5(a)]
    "given the retrieved ColorChecker values and the predefined oracle ColorChecker values, we optimize towards the CIEDE00 error and obtain the final color correction matrix ccm of the shape (3, 3). ... we conducted a ColorChecker-based evaluation on 100 randomly selected samples. In CIEDE00 (Luo et al., 2001), we obtained an average value of 5.84 and a median value of 5.07; ... demonstrating that our method can generally restore colors up to an accurate level."

    The CCM is fitted by minimizing CIEDE00 error on annotated ColorChecker patches (Sec 4.1 step 5), and Sec 4.2 then reports the ColorChecker-based CIEDE00 values as evidence that the reference frames are color-accurate ('generally restore colors up to an accurate level'). If the 100 sampled frames include the ColorChecker used to fit that frame's CCM, as the phrase 'ColorChecker-based evaluation' suggests, the average 5.84 / median 5.07 are residuals on the fitting target and are low by construction; they cannot independently validate the 'good RGB' reference. The benchmark rankings and the EV-UNet outdoor gain are separate held-out empirical comparisons, not derived from this fit, so the circularity is limited to the ISP-quality validation.

full rationale

This is a dataset/benchmark paper rather than a first-principles derivation, so most of the claimed chain is empirical. The dataset construction, the training/test split, and the PSNR/SSIM comparisons are not circular: the learned methods (including EV-UNet) are trained on a train split and evaluated on a test split, and the event stream is a real sensor measurement, not a function of the reference RGB. The one self-referential step is the validation of the controllable-ISP reference: the CIEDE00 color-accuracy numbers are produced by the same ColorChecker objective used to optimize the 3x3 color-correction matrix, so they measure fit-to-training-target rather than independent color accuracy. This weakens but does not by construction force the benchmark rankings or the event-benefit conclusion. No load-bearing self-citation chain or ansatz-smuggling is present; self-citations occur in related-work and model-selection contexts and are not the argument's foundation.

Assumptions & free parameters 3 free parameters · 4 assumptions · 3 invented entities

The central claim, that this is the first event-RAW paired dataset for ISP and that events can help ISP, rests on the reference pipeline's accuracy and the sensor's alignment, both of which are under the authors' control. No derivation is involved; the free parameters are in the reference ISP, not in a fitted law.

free parameters (3)
  • Color correction matrix (3x3) per scene = estimated per video from ColorChecker patch means
    Used in the controllable ISP (Sec 4.1 step 5) to map linear RGB to reference colors; fitted to 24-patch ColorChecker values, so the reference depends on it.
  • BM3D denoising strength sigma = 50
    Chosen by hand in Sec 4.1 step 4; affects reference image noise level and thus all benchmark scores.
  • Black level and fixed-pattern noise vector = calibrated in dark lab
    Subtracted from every RAW (Sec 4.1 step 1); per-row FPN vector is sensor-specific calibration data.
assumptions (4)
  • domain assumption Events and RAW frames from the ALPIX-Eiger HVS are pixel-aligned in time and space.
    Stated in Sec 3; the benchmark and fusion method rely on this alignment, but the sensor is confidential and alignment is not independently verified.
  • domain assumption The ColorChecker-based conventional ISP produces references accurate enough for benchmarking (mean CIEDE00 5.84).
    Sec 4.2 reports moderate color error; if the reference is biased, method rankings may not reflect true image quality.
  • domain assumption The 21st ColorChecker patch provides the ground-truth illumination for manual white balance.
    Sec 4.1 step 3; this is a standard but manual choice that affects all reference colors.
  • ad hoc to paper A single global black level and per-row FPN capture the sensor's fixed-pattern noise.
    Sec 4.1 step 1 assumes noise is only horizontal; other FPN structures could remain and distort references.
invented entities (3)
  • ALPIX-Eiger hybrid vision sensor (confidential prototype) independent evidence
    purpose: Captures pixel-aligned event streams and APS RAW frames for the dataset.
    The sensor exists and produces the released data, but its internal design is proprietary, so claims about alignment and noise are not independently checkable.
  • HVS-ISP dataset independent evidence
    purpose: First public dataset of aligned event-RAW pairs for ISP benchmarking.
    Released at the project GitHub; can be re-downloaded and re-processed, though generation details are controlled by the authors.
  • EV-UNet baseline independent evidence
    purpose: Simple event-fusion ISP model demonstrating event contribution.
    Reported results on the dataset; but architecture is just a voxel-grid plus U-Net concatenation, so limited insight.

how reviews work

0 comments
Cite this review

Pith. "Pith review of RGB-Event ISP: The Dataset and Benchmark." pith.science (2026). https://pith.science/paper/T23P3C2B

@misc{pith2026250119129,
  author       = {Pith},
  title        = {Pith review of: RGB-Event ISP: The Dataset and Benchmark},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/T23P3C2B}},
  note         = {Machine review of arXiv:2501.19129}
}
read the original abstract

Event-guided imaging has received significant attention due to its potential to revolutionize instant imaging systems. However, the prior methods primarily focus on enhancing RGB images in a post-processing manner, neglecting the challenges of image signal processor (ISP) dealing with event sensor and the benefits events provide for reforming the ISP process. To achieve this, we conduct the first research on event-guided ISP. First, we present a new event-RAW paired dataset, collected with a novel but still confidential sensor that records pixel-level aligned events and RAW images. This dataset includes 3373 RAW images with 2248 x 3264 resolution and their corresponding events, spanning 24 scenes with 3 exposure modes and 3 lenses. Second, we propose a conventional ISP pipeline to generate good RGB frames as reference. This conventional ISP pipleline performs basic ISP operations, e.g.demosaicing, white balancing, denoising and color space transforming, with a ColorChecker as reference. Third, we classify the existing learnable ISP methods into 3 classes, and select multiple methods to train and evaluate on our new dataset. Lastly, since there is no prior work for reference, we propose a simple event-guided ISP method and test it on our dataset. We further put forward key technical challenges and future directions in RGB-Event ISP. In summary, to the best of our knowledge, this is the very first research focusing on event-guided ISP, and we hope it will inspire the community. The code and dataset are available at: https://github.com/yunfanLu/RGB-Event-ISP.

Figures

Figures reproduced from arXiv: 2501.19129 by the authors.

Figure 1
Figure 1. (a), (b), and (c) display a RAW, Events, and RGB frame captured by the hybrid vision sensor (HVS), respectively. The RAW image follows a quad-Bayer pattern (Yang et al., 2022), while the events are positioned at the lower-right corner of each color pixel block, making the RAW resolution twice that of the events. (d) illustrates the traditional ISP process. (e) shows the potential event-guided ISP process, where the … view at source ↗
Figure 2
Figure 2. Overview of dataset collection. (a) illustrates the variety of scenes in the dataset, including [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Flows in controllable ISP process. (a) Quad-bayer pattern raw image, which serves as the initial input. (b) Black pattern and fixed-pattern noise removal to suppress sensor-induced artifacts. (c) Demosaicing to reconstruct a rgb image from the raw data. (d) White balancing using a ColorChecker for accurate color reproduction. (e) Denoising to filter out spatial noise from the image. (f) Color space transformation an… view at source ↗
Figures from the paper (5 more)
Figure 4
Figure 4. Figure 4: Fixed pattern noise (FPN) removal. (a) Visualizes the camera’s fixed pattern noise. (b) and (c) show the RGB images without and with fixed pattern noise removal, respectively. The im￾age in (c) demonstrates lower noise and more accurate white bal￾ance after the removal…
Figure 5
Figure 5. Figure 5: Color errors and fluctuations of our ISP method, computed using a ColorChecker. (a) CIEDE 2000 Error Probability Density Distribution: Displays CIEDE 2000 error values distribution with annotations for average (5.84), median (5.07), and maximum error means (14.62). (b)…
Figure 6
Figure 6. Figure 6: Visualization results of different methods on HVS-ISP Dataset outdoor scenes [PITH_FULL_IMAGE:figures/full_fig_p008_6.png]
Figure 7
Figure 7. Figure 7: Visualizations on HVS-ISP Dataset indoor scenes. poor performance mainly results from the limited receptive field of eSL, which is insufficient for estimating the global illumination information, and thus failing to achieve consistent global illumi￾nation enhancement. …
Figure 8
Figure 8. Figure 8: The ill-posedness of brightness estimation in the ISP pro￾cess. We visualized the 5×5 region in the RAW image and the bright￾ness of corresponding pixel in the color image at the center of this region. The results show that the same RAW region corresponds to different …

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Event Camera Guided Visual Media Restoration & 3D Reconstruction: A Survey

    cs.CV 2025-09 conditional novelty 1.0 of 10

    A structured survey of event-camera-guided video restoration and 3D reconstruction, organized by temporal, spatial, and 3D tasks.

Reference graph

Works this paper leans on

76 extracted references · 69 canonical work pages · cited by 1 Pith paper

  1. [1]

    A high-quality denoising dataset for smartphone cameras

    Abdelrahman Abdelhamed, Stephen Lin, and Michael S Brown. A high-quality denoising dataset for smartphone cameras. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 1692--1700, 2018

    work page 2018

  2. [2]

    Alpix-eiger product overview: https://alpsentek.com/product, 2024

    Alpsentek . Alpix-eiger product overview: https://alpsentek.com/product, 2024. URL https://alpsentek.com/product. Accessed: 2024-05-19

    work page 2024

  3. [3]

    Proposal for a standard default color space for the internet—srgb

    Matthew Anderson, Ricardo Motta, Srinivasan Chandrasekar, and Michael Stokes. Proposal for a standard default color space for the internet—srgb. In Color and imaging conference, volume 4, pp.\ 238--245. Society of Imaging Science and Technology, 1996

    work page 1996

  4. [4]

    Depth-aware video frame interpolation

    Wenbo Bao, Wei-Sheng Lai, Chao Ma, Xiaoyun Zhang, Zhiyong Gao, and Ming-Hsuan Yang. Depth-aware video frame interpolation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 3703--3712, 2019

    work page 2019

  5. [5]

    On the mathematical properties of the structural similarity index

    Dominique Brunet, Edward R Vrscay, and Zhou Wang. On the mathematical properties of the structural similarity index. IEEE Transactions on Image Processing, 21 0 (4): 0 1488--1499, 2011

    work page 2011

  6. [6]

    Real-world single image super-resolution: A brief review

    Honggang Chen, Xiaohai He, Linbo Qing, Yuanyuan Wu, Chao Ren, Ray E Sheriff, and Ce Zhu. Real-world single image super-resolution: A brief review. Information Fusion, 79: 0 124--145, 2022

    work page 2022

  7. [8]

    ISP meets Deep Learning: A Survey on Deep Learning Methods for Image Signal Processing

    Matheus Henrique Marques da Silva, Jhessica Victoria Santos da Silva, Rodrigo Reis Arrais, Wladimir Barroso Guedes de Ara \'u jo Neto, Leonardo Tadeu Lopes, Guilherme Augusto Bileki, Iago Oliveira Lima, Lucas Borges Rondon, Bruno Melo de Souza, Mayara Costa Regazio, et al. Survey on software isp methods based on deep learning. arXiv preprint arXiv:2305.11...

    work page Pith review arXiv 2023

  8. [9]

    Bm3d image denoising with shape-adaptive principal component analysis

    Kostadin Dabov, Alessandro Foi, Vladimir Katkovnik, and Karen Egiazarian. Bm3d image denoising with shape-adaptive principal component analysis. In SPARS'09-Signal Processing with Adaptive Sparse Structured Representations, 2009

    work page 2009

Show all 76 references
  1. [10]

    Awnet: Attentive wavelet network for image isp

    Linhui Dai, Xiaohong Liu, Chengqi Li, and Jun Chen. Awnet: Attentive wavelet network for image isp. In Computer Vision--ECCV 2020 Workshops: Glasgow, UK, August 23--28, 2020, Proceedings, Part III 16, pp.\ 185--201. Springer, 2020

    2020

  2. [11]

    Mobile computational photography: A tour

    Mauricio Delbracio, Damien Kelly, Michael S Brown, and Peyman Milanfar. Mobile computational photography: A tour. Annual review of vision science, 7: 0 571--604, 2021

    2021

  3. [12]

    Color correction using root-polynomial regression

    Graham D Finlayson, Michal Mackiewicz, and Anya Hurlbert. Color correction using root-polynomial regression. IEEE Transactions on Image Processing, 24 0 (5): 0 1460--1470, 2015

    2015

  4. [13]

    u ck, Garrick Orchard, Chiara Bartolozzi, Brian Taba, Andrea Censi, Stefan Leutenegger, Andrew J Davison, J \

    Guillermo Gallego, Tobi Delbr \"u ck, Garrick Orchard, Chiara Bartolozzi, Brian Taba, Andrea Censi, Stefan Leutenegger, Andrew J Davison, J \"o rg Conradt, Kostas Daniilidis, et al. Event-based vision: A survey. IEEE transactions on pattern analysis and machine intelligence, 4...

    2020

  5. [14]

    Computer-synthesis of an interference color chart of human tear lipid layer, by a colorimetric approach

    Eiki Goto, Murat Dogru, Takashi Kojima, and Kazuo Tsubota. Computer-synthesis of an interference color chart of human tear lipid layer, by a colorimetric approach. Investigative ophthalmology & visual science, 44 0 (11): 0 4693--4697, 2003

    2003

  6. [15]

    Joint demosaicing and denoising

    Keigo Hirakawa and Thomas W Parks. Joint demosaicing and denoising. IEEE Transactions on Image Processing, 15 0 (8): 0 2146--2157, 2006

    2006

  7. [16]

    Image quality metrics: Psnr vs

    Alain Hore and Djemel Ziou. Image quality metrics: Psnr vs. ssim. In 2010 20th international conference on pattern recognition, pp.\ 2366--2369. IEEE, 2010

    2010

  8. [17]

    6-dof vr videos with a single 360-camera

    Jingwei Huang, Zhili Chen, Duygu Ceylan, and Hailin Jin. 6-dof vr videos with a single 360-camera. In 2017 IEEE Virtual Reality (VR), pp.\ 37--44. IEEE, 2017

    2017

  9. [18]

    Aim 2020 challenge on learned image signal processing pipeline

    Andrey Ignatov, Radu Timofte, Zhilu Zhang, Ming Liu, Haolin Wang, Wangmeng Zuo, Jiawei Zhang, Ruimao Zhang, Zhanglin Peng, Sijie Ren, et al. Aim 2020 challenge on learned image signal processing pipeline. In Computer Vision--ECCV 2020 Workshops: Glasgow, UK, August 23--28, 202...

    2020

  10. [19]

    Replacing mobile camera isp with a single deep learning model

    Andrey Ignatov, Luc Van Gool, and Radu Timofte. Replacing mobile camera isp with a single deep learning model. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp.\ 536--537, 2020 b

    2020

  11. [20]

    Tesla autopilot: semi autonomous driving, an uptick for future autonomy

    Shantanu Ingle and Madhuri Phute. Tesla autopilot: semi autonomous driving, an uptick for future autonomy. International Research Journal of Engineering and Technology, 3 0 (9): 0 369--372, 2016

    2016

  12. [21]

    Learning event-based motion deblurring

    Zhe Jiang, Yu Zhang, Dongqing Zou, Jimmy Ren, Jiancheng Lv, and Yebin Liu. Learning event-based motion deblurring. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 3320--3329, 2020

    2020

  13. [22]

    Turning frequency to resolution: Video super-resolution via event cameras

    Yongcheng Jing, Yiding Yang, Xinchao Wang, Mingli Song, and Dacheng Tao. Turning frequency to resolution: Video super-resolution via event cameras. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 7772--7781, 2021

    2021

  14. [23]

    Pynet-ca: enhanced pynet with channel attention for end-to-end mobile image signal processing

    Byung-Hoon Kim, Joonyoung Song, Jong Chul Ye, and JaeHyun Baek. Pynet-ca: enhanced pynet with channel attention for end-to-end mobile image signal processing. In European Conference on Computer Vision, pp.\ 202--212. Springer, 2020

    2020

  15. [24]

    Theory and applications of smart cameras

    Chong-Min Kyung et al. Theory and applications of smart cameras. Springer, 2016

    2016

  16. [25]

    Comparison of cie lab, ciede 2000, and din 99 color differences between various shades of resin composites

    Yong-Keun Lee and John M Powers. Comparison of cie lab, ciede 2000, and din 99 color differences between various shades of resin composites. International Journal of Prosthodontics, 18 0 (2), 2005

    2000

  17. [26]

    Design of black level calibration system for cmos image sensor

    Zhaowen Li, Tingcun Wei, and Ran Zheng. Design of black level calibration system for cmos image sensor. In 2010 International Conference on Computer Application and System Modeling (ICCASM 2010), volume 10, pp.\ V10--643. IEEE, 2010

    2010

  18. [27]

    Towards robust event-guided low-light image enhancement: A large-scale real-world event-image dataset and novel approach

    Guoqiang Liang, Kanghao Chen, Hangyu Li, Yunfan Lu, and Lin Wang. Towards robust event-guided low-light image enhancement: A large-scale real-world event-image dataset and novel approach. arXiv preprint arXiv:2404.00834, 2024

    2024 arXiv

  19. [28]

    Coherent event guided low-light video enhancement

    Jinxiu Liang, Yixin Yang, Boyu Li, Peiqi Duan, Yong Xu, and Boxin Shi. Coherent event guided low-light video enhancement. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 10615--10625, 2023

    2023

  20. [29]

    Cameranet: A two-stage framework for effective camera isp learning

    Zhetong Liang, Jianrui Cai, Zisheng Cao, and Lei Zhang. Cameranet: A two-stage framework for effective camera isp learning. IEEE Transactions on Image Processing, 30: 0 2248--2262, 2021

    2021

  21. [30]

    Active pixel sensor (aps) based star tracker

    Carl C Liebe, Edwin W Dennison, Bruce Hancock, Robert C Stirbl, and Bedabrata Pain. Active pixel sensor (aps) based star tracker. In 1998 IEEE Aerospace Conference Proceedings (Cat. No. 98TH8339), volume 1, pp.\ 119--127. IEEE, 1998

    1998

  22. [31]

    Learning event-driven video deblurring and interpolation

    Songnan Lin, Jiawei Zhang, Jinshan Pan, Zhe Jiang, Dongqing Zou, Yongtian Wang, Jing Chen, and Jimmy Ren. Learning event-driven video deblurring and interpolation. In Computer Vision--ECCV 2020: 16th European Conference, Glasgow, UK, August 23--28, 2020, Proceedings, Part VIII...

    2020

  23. [32]

    Voxel-based multi-scale transformer network for event stream processing

    Daikun Liu, Teng Wang, and Changyin Sun. Voxel-based multi-scale transformer network for event stream processing. IEEE Transactions on Circuits and Systems for Video Technology, 2023

    2023

  24. [33]

    Swin transformer: Hierarchical vision transformer using shifted windows

    Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision, pp.\ 10012--10022, 2021

    2021

  25. [34]

    Self-supervised learning of event-guided video frame interpolation for rolling shutter frames

    Yunfan Lu, Guoqiang Liang, and Lin Wang. Self-supervised learning of event-guided video frame interpolation for rolling shutter frames. arXiv preprint arXiv:2306.15507, 2023 a

    2023 arXiv

  26. [35]

    Learning spatial-temporal implicit neural representations for event-guided video super-resolution

    Yunfan Lu, Zipeng Wang, Minjie Liu, Hongjian Wang, and Lin Wang. Learning spatial-temporal implicit neural representations for event-guided video super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 1557--1567, 2023 b

    2023

  27. [36]

    Event camera demosaicing via swin transformer and pixel-focus loss

    Yunfan Lu, Yijie Xu, Wenzong Ma, Weiyu Guo, and Hui Xiong. Event camera demosaicing via swin transformer and pixel-focus loss. arXiv preprint arXiv:2404.02731, 2024

    2024 arXiv

  28. [37]

    The development of the cie 2000 colour-difference formula: Ciede2000

    M Ronnier Luo, Guihua Cui, and Bryan Rigg. The development of the cie 2000 colour-difference formula: Ciede2000. Color Research & Application: Endorsed by Inter-Society Color Council, The Colour Group (Great Britain), Canadian Society for Color, Color Science Association of Ja...

    2000

  29. [38]

    Evaluation of uniform color spaces developed after the adoption of cielab and cieluv

    Marc Mahy, Luc Van Eycken, and Andr \'e Oosterlinck. Evaluation of uniform color spaces developed after the adoption of cielab and cieluv. Color Research & Application, 19 0 (2): 0 105--121, 1994

    1994

  30. [39]

    Camera color correction using two-dimensional transforms

    Jon S McElvain and Walter Gish. Camera color correction using two-dimensional transforms. In Color and Imaging Conference, volume 21, pp.\ 250--256. Society for Imaging Science and Technology, 2013

    2013

  31. [40]

    Multi-bracket high dynamic range imaging with event cameras

    Nico Messikommer, Stamatios Georgoulis, Daniel Gehrig, Stepan Tulyakov, Julius Erbach, Alfredo Bochicchio, Yuanyou Li, and Davide Scaramuzza. Multi-bracket high dynamic range imaging with event cameras. In Proceedings of the IEEE/CVF conference on computer vision and pattern r...

    2022

  32. [41]

    Mobile intelligent photography and imaging workshop 2024

    MIPI Challenge 2024 . Mobile intelligent photography and imaging workshop 2024. https://mipi-challenge.org/MIPI2024/, 2024

    2024

  33. [42]

    Video frame interpolation via adaptive separable convolution

    Simon Niklaus, Long Mai, and Feng Liu. Video frame interpolation via adaptive separable convolution. In Proceedings of the IEEE international conference on computer vision, pp.\ 261--270, 2017

    2017

  34. [43]

    Bringing a blurry frame alive at high frame-rate with an event camera

    Liyuan Pan, Cedric Scheerlinck, Xin Yu, Richard Hartley, Miaomiao Liu, and Yuchao Dai. Bringing a blurry frame alive at high frame-rate with an event camera. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 6820--6829, 2019

    2019

  35. [44]

    Automatic differentiation in pytorch

    Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. Automatic differentiation in pytorch. 2017

    2017

  36. [45]

    Contemporary optical image processing with MATLAB

    T-C Poon and Partha P Banerjee. Contemporary optical image processing with MATLAB. Elsevier, 2001

    2001

  37. [46]

    Recurrent color constancy

    Yanlin Qian, Ke Chen, Jarno Nikkanen, Joni-Kristian Kamarainen, and Jiri Matas. Recurrent color constancy. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), Oct 2017

    2017

  38. [47]

    On finding gray pixels

    Yanlin Qian, Joni-Kristian Kamarainen, Jarno Nikkanen, and Jiri Matas. On finding gray pixels. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2019

    2019

  39. [48]

    Quadbayer cfa modified gradient-based demosaicing, 2022

    Rainbow-Johnny-Johnny-Image-Processing-Lim. Quadbayer cfa modified gradient-based demosaicing, 2022. URL https://www.mathworks.com/matlabcentral/fileexchange/116085-quadbayer-cfa-modified-gradient-based-demosaicing. Accessed: 2024-06-01

    2022

  40. [49]

    U-net: Convolutional networks for biomedical image segmentation

    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U-net: Convolutional networks for biomedical image segmentation. In Medical image computing and computer-assisted intervention--MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part...

    2015

  41. [50]

    Labelme: a database and web-based tool for image annotation

    Bryan C Russell, Antonio Torralba, Kevin P Murphy, and William T Freeman. Labelme: a database and web-based tool for image annotation. International journal of computer vision, 77: 0 157--173, 2008

    2008

  42. [51]

    Ced: Color event camera dataset

    Cedric Scheerlinck, Henri Rebecq, Timo Stoffregen, Nick Barnes, Robert Mahony, and Davide Scaramuzza. Ced: Color event camera dataset. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp.\ 0--0, 2019

    2019

  43. [52]

    Deepisp: Toward learning an end-to-end image processing pipeline

    Eli Schwartz, Raja Giryes, and Alex M Bronstein. Deepisp: Toward learning an end-to-end image processing pipeline. IEEE Transactions on Image Processing, 28 0 (2): 0 912--923, 2018

    2018

  44. [53]

    Event cameras in automotive sensing: A review

    Waseem Shariff, Mehdi Sefidgar Dilmaghani, Paul Kielty, Mohamed Moustafa, Joe Lemley, and Peter Corcoran. Event cameras in automotive sensing: A review. IEEE Access, 2024

    2024

  45. [54]

    Transform your smartphone into a dslr camera: Learning the isp in the wild

    Ardhendu Shekhar Tripathi, Martin Danelljan, Samarth Shukla, Radu Timofte, and Luc Van Gool. Transform your smartphone into a dslr camera: Learning the isp in the wild. In European Conference on Computer Vision, pp.\ 625--641. Springer, 2022

    2022

  46. [55]

    E-cir: Event-enhanced continuous intensity recovery

    Chen Song, Qixing Huang, and Chandrajit Bajaj. E-cir: Event-enhanced continuous intensity recovery. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 7803--7812, 2022

    2022

  47. [56]

    Colour correction for panoramic imaging

    Gui Yun Tian, Duke Gledhill, David Taylor, and David Clarke. Colour correction for panoramic imaging. In Proceedings Sixth International Conference on Information Visualisation, pp.\ 483--488. IEEE, 2002

    2002

  48. [57]

    Time lens: Event-based video frame interpolation

    Stepan Tulyakov, Daniel Gehrig, Stamatios Georgoulis, Julius Erbach, Mathias Gehrig, Yuanyou Li, and Davide Scaramuzza. Time lens: Event-based video frame interpolation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 16155--16164, 2021

    2021

  49. [58]

    Time lens++: Event-based frame interpolation with parametric non-linear flow and multi-scale fusion

    Stepan Tulyakov, Alfredo Bochicchio, Daniel Gehrig, Stamatios Georgoulis, Yuanyou Li, and Davide Scaramuzza. Time lens++: Event-based frame interpolation with parametric non-linear flow and multi-scale fusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pa...

    2022

  50. [59]

    Event enhanced high-quality image recovery

    Bishan Wang, Jingwei He, Lei Yu, Gui-Song Xia, and Wen Yang. Event enhanced high-quality image recovery. In Computer Vision--ECCV 2020: 16th European Conference, Glasgow, UK, August 23--28, 2020, Proceedings, Part XIII 16, pp.\ 155--171. Springer, 2020 a

    2020

  51. [60]

    An experiment-based review of low-light image enhancement methods

    Wencheng Wang, Xiaojin Wu, Xiaohui Yuan, and Zairui Gao. An experiment-based review of low-light image enhancement methods. Ieee Access, 8: 0 87884--87917, 2020 b

    2020

  52. [61]

    A novel automatic white balance method for digital still cameras

    Ching-Chih Weng, Homer Chen, and Chiou-Shann Fuh. A novel automatic white balance method for digital still cameras. In 2005 IEEE International Symposium on Circuits and Systems (ISCAS), pp.\ 3801--3804. IEEE, 2005

    2005

  53. [62]

    Hdr imaging for dynamic scenes with events

    Li Xiaopeng, Zeng Zhaoyuan, Fan Cien, Zhao Chen, Deng Lei, and Yu Lei. Hdr imaging for dynamic scenes with events. arXiv preprint arXiv:2404.03210, 2024

    2024 arXiv

  54. [63]

    Invertible image signal processing

    Yazhou Xing, Zian Qian, and Qifeng Chen. Invertible image signal processing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 6287--6296, 2021

    2021

  55. [64]

    Motion deblurring with real events

    Fang Xu, Lei Yu, Bishan Wang, Wen Yang, Gui-Song Xia, Xu Jia, Zhendong Qiao, and Jianzhuang Liu. Motion deblurring with real events. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 2583--2592, 2021

    2021

  56. [65]

    " seeing" electric network frequency from events

    Lexuan Xu, Guang Hua, Haijian Zhang, Lei Yu, and Ning Qiao. " seeing" electric network frequency from events. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 18022--18031, 2023

    2023

  57. [66]

    Mipi 2022 challenge on quad-bayer re-mosaic: Dataset and report

    Qingyu Yang, Guang Yang, Jun Jiang, Chongyi Li, Ruicheng Feng, Shangchen Zhou, Wenxiu Sun, Qingpeng Zhu, Chen Change Loy, Jinwei Gu, et al. Mipi 2022 challenge on quad-bayer re-mosaic: Dataset and report. In European Conference on Computer Vision, pp.\ 21--35. Springer, 2022

    2022

  58. [67]

    Mipi 2024 challenge on demosaic for hybridevs camera: Methods and results

    Wu Yaqi, Fan Zhihao, Chu Xiaofeng, Ren Jimmy S., Li Xiaoming, Yue Zongsheng, Li Chongyi, Zhou Shangcheng, Feng Ruicheng, Dai Yuekun, Yang Peiqing, Loy Chen Change, et al. Mipi 2024 challenge on demosaic for hybridevs camera: Methods and results. In Proceedings of the IEEE/CVF ...

    2024

  59. [68]

    Image deblurring with blurred/noisy image pairs

    Lu Yuan, Jian Sun, Long Quan, and Heung-Yeung Shum. Image deblurring with blurred/noisy image pairs. In ACM SIGGRAPH 2007 papers, pp.\ 1--es. 2007

    2007

  60. [69]

    Uniinr: Unifying spatial-temporal inr for rs video correction, deblur, and interpolation with an event camera

    LU Yunfan, Guoqiang Liang, and Lin Wang. Uniinr: Unifying spatial-temporal inr for rs video correction, deblur, and interpolation with an event camera. 2023

    2023

  61. [70]

    Deep image deblurring: A survey

    Kaihao Zhang, Wenqi Ren, Wenhan Luo, Wei-Sheng Lai, Bj \"o rn Stenger, Ming-Hsuan Yang, and Hongdong Li. Deep image deblurring: A survey. International Journal of Computer Vision, 130 0 (9): 0 2103--2130, 2022

    2022

  62. [71]

    Unifying motion deblurring and frame interpolation with events

    Xiang Zhang and Lei Yu. Unifying motion deblurring and frame interpolation with events. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 17765--17774, 2022

    2022

  63. [72]

    Evunroll: Neuromorphic events based rolling shutter image correction

    Xinyu Zhou, Peiqi Duan, Yi Ma, and Boxin Shi. Evunroll: Neuromorphic events based rolling shutter image correction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 17775--17784, 2022

    2022

  64. [73]

    Vision meets drones: A challenge

    Pengfei Zhu, Longyin Wen, Xiao Bian, Haibin Ling, and Qinghua Hu. Vision meets drones: A challenge. arXiv preprint arXiv:1804.07437, 2018

    2018 arXiv

  65. [74]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...

  66. [75]

    @esa (Ref

    \@ifxundefined[1] #1\@undefined \@firstoftwo \@secondoftwo \@ifnum[1] #1 \@firstoftwo \@secondoftwo \@ifx[1] #1 \@firstoftwo \@secondoftwo [2] @ #1 \@temptokena #2 #1 @ \@temptokena \@ifclassloaded agu2001 natbib The agu2001 class already includes natbib coding, so you should ...

  67. [76]

    \@lbibitem[] @bibitem@first@sw\@secondoftwo \@lbibitem[#1]#2 \@extra@b@citeb \@ifundefined br@#2\@extra@b@citeb \@namedef br@#2 \@nameuse br@#2\@extra@b@citeb \@ifundefined b@#2\@extra@b@citeb @num @parse #2 @tmp #1 NAT@b@open@#2 NAT@b@shut@#2 \@ifnum @merge>\@ne @bibitem@firs...

  68. [77]

    Top two models are highlighted in red and green

    @open @close @open @close and [1] URL: #1 \@ifundefined chapter * \@mkboth \@ifxundefined @sectionbib * \@mkboth * \@mkboth\@gobbletwo \@ifclassloaded amsart * \@ifclassloaded amsbook * \@ifxundefined @heading @heading NAT@ctr thebibliography [1] @ \@biblabel @NAT@ctr \@bibset...

Pith tools

Reviewed August 9, 2026 · model on record in the stance chip above.