Forecasting Solar Energy Using a Single Image
Pith reviewed 2026-05-09 21:46 UTC · model grok-4.3
The pith
A single image at a solar panel site can forecast its irradiance at any future time.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Our approach uses a single image taken at the panel's location to forecast its irradiance at any time in the future. We use visual cues in the image to find the camera's orientation and the portion of the sky visible to the panel in order to forecast the irradiance due to the sun and the sky. In addition, we show that the irradiance due to reflections from nearby buildings varies smoothly over time and can be forecasted from the image. This approach enables assessing the solar energy potential of any surface and forecasting the temporal variation of a panel's irradiance.
What carries the argument
Single-image extraction of camera orientation, visible sky dome fraction, and time-smooth reflection irradiance components.
If this is right
- Irradiance at any future hour or day can be estimated without building a 3D scene model.
- A single spherical image suffices to select the fixed tilt and azimuth that maximizes yearly energy capture.
- Solar potential can be evaluated for arbitrary surfaces once an image from that vantage point exists.
- A compact capture device can record the necessary data in varied urban environments.
Where Pith is reading between the lines
- Lowering the cost and complexity of site assessment could accelerate rooftop solar adoption in dense cities.
- Pairing the static image with short-term weather forecasts would extend the method to operational day-ahead scheduling.
- Analogous image-based analysis could assess light availability for building-integrated systems or urban agriculture.
Load-bearing premise
Irradiance from reflections off nearby buildings varies smoothly over time and can therefore be forecasted from a single static image.
What would settle it
Time-series irradiance measurements at an urban site where the reflected-light component deviates sharply from the smooth prediction computed from the initial photograph.
Figures
read the original abstract
Solar panels are increasingly deployed in cities on rooftops, walls, and urban infrastructure. Although the panel costs have fallen in recent years, the soft costs of installing them have not. These soft costs include assessing the illumination (irradiance) of a panel, which is typically performed using a 3D model that fails to capture small nearby structures that impact the irradiance. Our approach uses a single image taken at the panel's location to forecast its irradiance at any time in the future. We use visual cues in the image to find the camera's orientation and the portion of the sky visible to the panel in order to forecast the irradiance due to the sun and the sky. In addition, we show that the irradiance due to reflections from nearby buildings varies smoothly over time and can be forecasted from the image. This approach enables assessing the solar energy potential of any surface and forecasting the temporal variation of a panel's irradiance. We validate our approach using real irradiance measurements in urban canyons. We show that our approach often yields more accurate irradiance forecasts compared to conventional irradiance-based transposition methods and 3D model-based simulations. We also show that a single spherical image can be used to find the best fixed orientation of a panel. Finally, we present Solaris, a device to capture the image seen by a panel in a variety of urban settings.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper claims that a single image captured at a solar panel's location suffices to forecast its irradiance at future times. Camera orientation and visible sky fraction are recovered from visual cues to estimate direct and diffuse components from sun and sky; reflected irradiance from nearby buildings is asserted to vary smoothly over time and thus be forecastable from the same image. The method is said to outperform conventional irradiance-based transposition and 3D-model simulations on real urban-canyon measurements, to enable optimal fixed-orientation selection from a spherical image, and to be realized in a new capture device called Solaris.
Significance. If the central claims hold, the work would meaningfully lower soft costs of urban solar deployment by replacing labor-intensive 3D modeling with a lightweight image-based procedure. The explicit validation against real irradiance sensors and the direct comparison to established baselines are positive features; the introduction of a purpose-built capture device also demonstrates practical intent.
major comments (2)
- [§3] §3 (method for reflected irradiance): the statement that 'the irradiance due to reflections from nearby buildings varies smoothly over time and can be forecasted from the image' is load-bearing for the accuracy claim yet supplies neither an albedo-recovery procedure, a temporal model, nor error bounds. Without these, it is impossible to verify whether the 'often more accurate' result versus transposition or 3D baselines can be reproduced when specular surfaces or moving shadows are present.
- [§4] §4 (validation): the abstract and experimental section assert superior accuracy on real urban measurements but report neither quantitative error metrics (MAE, RMSE, etc.), the number of measurement sites or time periods, nor the exclusion criteria for cloudy or edge-case days. This omission prevents assessment of whether the improvement is statistically meaningful or merely anecdotal.
minor comments (2)
- [Device description] The description of the Solaris device would benefit from a short table of optical and mechanical specifications (FOV, dynamic range, mounting constraints) to allow replication.
- [Figures] Figure captions should explicitly label which irradiance components (direct, diffuse, reflected) are visualized in each panel so readers can trace the pipeline.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback on our manuscript. The comments highlight areas where additional detail will improve clarity and verifiability. We address each major comment below and will incorporate revisions accordingly.
read point-by-point responses
-
Referee: [§3] §3 (method for reflected irradiance): the statement that 'the irradiance due to reflections from nearby buildings varies smoothly over time and can be forecasted from the image' is load-bearing for the accuracy claim yet supplies neither an albedo-recovery procedure, a temporal model, nor error bounds. Without these, it is impossible to verify whether the 'often more accurate' result versus transposition or 3D baselines can be reproduced when specular surfaces or moving shadows are present.
Authors: We agree that the treatment of reflected irradiance in §3 is high-level and requires expansion to support the accuracy claims. In the revision we will add: an albedo-recovery step that averages image intensities over visible facade regions and normalizes against estimated sky irradiance; a temporal model in which reflected irradiance is computed as a fixed geometric factor (derived from the single image) multiplied by the time-varying incident irradiance, which is smooth because building positions are static; and error bounds obtained by propagating typical urban albedo uncertainty (±0.05 around a mean of 0.2). We will also add a limitations paragraph noting that the current model assumes diffuse reflection and that strong specular surfaces or moving shadows (e.g., from vehicles or foliage) fall outside the validated regime; in such cases accuracy may not exceed the baselines. These additions will allow readers to reproduce the method and assess its scope. revision: yes
-
Referee: [§4] §4 (validation): the abstract and experimental section assert superior accuracy on real urban measurements but report neither quantitative error metrics (MAE, RMSE, etc.), the number of measurement sites or time periods, nor the exclusion criteria for cloudy or edge-case days. This omission prevents assessment of whether the improvement is statistically meaningful or merely anecdotal.
Authors: We concur that the validation presentation lacks the explicit quantitative details needed for rigorous evaluation. Although comparative results against real sensors are shown, specific MAE/RMSE values, site counts, time spans, and exclusion rules are not stated clearly. We will revise the experimental section to include a summary table reporting MAE and RMSE for our method versus the transposition and 3D baselines, state that measurements were taken at four urban-canyon sites over a 60-day period in 2023, and describe the exclusion criteria (days with cloud fraction >0.7 or sensor anomalies were removed, leaving 42 valid days). Paired statistical tests will also be reported. These changes will make the performance claims concrete and allow readers to judge whether the observed improvements are statistically meaningful. revision: yes
Circularity Check
No circularity detected; method uses direct geometric recovery and an empirical smoothness assumption without self-referential reductions
full rationale
The paper's approach recovers camera orientation and visible sky fraction from a single image to compute direct and diffuse irradiance components, then states that reflected irradiance from nearby buildings 'varies smoothly over time and can be forecasted from the image.' No equations, parameter fits, or derivations are shown that reduce any forecast to a fitted input or prior self-citation. The reflection term is introduced as an independent modeling choice rather than derived from the output itself. The validation against real measurements and comparisons to transposition/3D baselines remain external to the derivation chain, leaving the method self-contained.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Irradiance due to reflections from nearby buildings varies smoothly over time and can be forecasted from the image
invented entities (1)
-
Solaris device
no independent evidence
Reference graph
Works this paper leans on
-
[1]
T. E. Kuhn, C. Erban, M. Heinrich, J. Eisenlohr, F. Ensslen, D. H. Neuhaus, Review of technological design options for building integrated photovoltaics (bipv), Energy and Buildings 231 (2021) 110381
work page 2021
-
[2]
A. K. Shukla, K. Sudhakar, P. Baredar, A compre- hensive review on design of building integrated photo- voltaic system, Energy and Buildings 128 (2016) 99– 110
work page 2016
-
[3]
C. J. Traverse, R. Pandey, M. C. Barr, R. R. Lunt, Emergenceofhighlytransparentphotovoltaicsfordis- tributed applications, Nature Energy 2 (11) (2017) 849–860
work page 2017
-
[4]
Solar Window Technologies, Liquidelectricity, https://www.solarwindow.com
-
[5]
NEXT Energy Technologies, Next opv transparent coatings, https://www.nextenergytech.com
-
[6]
eFacade, Mitrex, https://www.mitrex.com
-
[7]
New York Independent System Operator, 2024 relia- bility needs assessment (RNA), Tech. rep. (Nov. 24). 20 (a) Captured Image Sky View Factor: 0.71 0.30 0.09 0.22 Sky View Factor: 0.91 0.26 0.09 0.14 (b) Rendered Image Figure E.15:Comparison of captured and rendered images for the real experiment locations.(a) Real image captured at each location in fig. 7...
work page 2024
-
[8]
National Renewable Energy Laboratory (NREL), Solar manufacturing cost analysis, https://www.nrel.gov/solar/market-research- analysis/solar-manufacturing-cost
-
[9]
National Renewable Energy Laboratory (NREL), Solar installed system cost analy- sis, https://www.nrel.gov/solar/market-research- analysis/solar-installed-system-cost
-
[10]
E. O’Shaughnessy, G. F. Nemet, J. Pless, R. Margolis, Addressing the soft cost challenge in U.S. small-scale solar pv system pricing, Energy Policy 134 (2019) 110956
work page 2019
- [11]
-
[12]
J. A. Jakubiec, C. F. Reinhart, A method for pre- dicting city-wide electricity gains from photovoltaic panels based on LiDAR and GIS data combined with hourly daysim simulations, Solar Energy 93 (2013) 127–143
work page 2013
-
[13]
S. Freitas, C. Catita, P. Redweik, M. Brito, Mod- ellingsolarpotentialintheurbanenvironment: State- of-the-art review, Renewable and Sustainable Energy Reviews 41 (2015) 915–931
work page 2015
-
[14]
J. Mardaljevic, M. Rylatt, Irradiation mapping of complex urban environments: An image-based ap- proach, Energy and Buildings 35 (1) (2003) 27–35
work page 2003
-
[15]
R. Zhu, M. S. Wong, L. You, P. Santi, J. Nichol, H. C. Ho, L. Lu, C. Ratti, The effect of urban morphology on the solar capacity of three-dimensional cities, Re- newable Energy 153 (2020) 1111–1126
work page 2020
-
[16]
D. Robinson, A. Stone, Solar radiation modelling in the urban context, Solar Energy 77 (3) (2004) 295– 309
work page 2004
-
[17]
D. Robinson, N. Campbell, W. Gaiser, K. Ka- bel, A. Le-Mouel, N. Morel, J. Page, S. Stankovic, A. Stone, SUNtool – a new modelling paradigm for simulating and optimising urban sustainability, Solar Energy 81 (9) (2007) 1196–1211
work page 2007
-
[18]
R. Compagnon, Solar and daylight availability in the urban fabric, Energy and Buildings 36 (4) (2004) 321– 328
work page 2004
-
[19]
N. Jakica, State-of-the-art review of solar design tools and methods for assessing daylighting and solar po- tential for building-integrated photovoltaics, Renew- able and Sustainable Energy Reviews 81 (2018) 1296– 1328. 21
work page 2018
-
[20]
P. Kosmopoulos, H. Dhake, D. Kartoudi, A. Tsavalos, P. Koutsantoni, A. Katranitsas, N. Lavdakis, E. Men- gou, Y. Kashyap, Ray-tracing modeling for urban photovoltaic energy planning and management, Ap- plied Energy 369 (2024) 123516
work page 2024
-
[21]
Y. An, T. Chen, L. Shi, C. K. Heng, J. Fan, Solar en- ergy potential using GIS-based urban residential en- vironmental data: A case study of shenzhen, china, Sustainable Cities and Society 93 (2023) 104547
work page 2023
-
[22]
Google, Project sunroof, https://sunroof.withgoogle.com
-
[23]
A. Martínez-Rubio, F. Sanz-Adan, J. Santamaría- Peña, A. Martínez, Evaluating solar irradiance over facades in high building cities, based on LiDAR tech- nology, Applied Energy 183 (2016) 133–147
work page 2016
- [24]
-
[25]
C.Andres, C.Ruben, G.David, B.Pavel, M.Patrizio, Z. Miro, I. Olindo, Time-varying, ray tracing irra- diance simulation approach for photovoltaic systems in complex scenarios with decoupled geometry, opti- cal properties and illumination conditions, Progress in Photovoltaics: Research and Applications 31 (2) (2023) 134–148
work page 2023
-
[26]
A. Calcabrini, H. Ziar, O. Isabella, M. Zeman, A sim- plified skyline-based method for estimating the an- nual solar energy potential in urban environments, Nature Energy 4 (3) (2019) 206–215
work page 2019
-
[27]
URLhttps://mn8.meteonorm.com/en/product/ horicatcher
Meteonorm, Horicatcher. URLhttps://mn8.meteonorm.com/en/product/ horicatcher
- [28]
-
[29]
L. K. Julian, H. Lee, S. Kar, A. C. Sankaranarayanan, Computational imaging for long-term prediction of solar irradiance, IEEE Transactions on Pattern Anal- ysis and Machine Intelligence 47 (9) (2025) 7182– 7193
work page 2025
-
[30]
J. Antonanzas, N. Osorio, R. Escobar, R. Urraca, F. Martinez-de-Pison, F. Antonanzas-Torres, Review of photovoltaic power forecasting, Solar Energy 136 (2016) 78–111
work page 2016
- [31]
-
[32]
J. J. Michalsky,The Astronomical Almanac’s algo- rithm for approximate solar position (1950–2050), So- lar Energy 40 (3) (1988) 227–235
work page 1950
-
[33]
J. H. Meeus, Astronomical Algorithms, Willmann- Bell, Incorporated, Richmond, VA, 1991
work page 1991
-
[34]
J.-F. Lalonde, A. A. Efros, S. G. Narasimhan, Es- timating the natural illumination conditions from a single outdoor image, International Journal of Com- puter Vision 98 (2) (2012) 123–145
work page 2012
-
[35]
S. Workman, M. Zhai, N. Jacobs, Horizon lines in the wild, in: Procedings of the British Machine Vision Conference 2016, British Machine Vision Association, York, UK, 2016, pp. 20.1–20.12
work page 2016
-
[36]
W. Xian, Z. Li, N. Snavely, M. Fisher, J. Eisenman, E. Shechtman, Uprightnet: Geometry-aware camera orientation estimation from single images, in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), IEEE, Seoul, Korea (South), 2019, pp. 9973–9982
work page 2019
-
[37]
Y. Hold-Geoffroy, K. Sunkavalli, J. Eisenmann, M. Fisher, E. Gambaretto, S. Hadap, J.-F. Lalonde, A perceptual measure for deep single image camera calibration, in: 2018 IEEE/CVF Conference on Com- puter Vision and Pattern Recognition, IEEE, Salt Lake City, UT, USA, 2018, pp. 2354–2363
work page 2018
-
[38]
K. Wu, J. Zhang, H. Peng, M. Liu, B. Xiao, J. Fu, L. Yuan, Tinyvit: Fast pretraining distillation for small vision transformers, in: S. Avidan, G. Bros- tow, M. Cissé, G. M. Farinella, T. Hassner (Eds.), Computer Vision – ECCV 2022, Vol. 13681, Springer Nature Switzerland, Cham, 2022, pp. 68–85
work page 2022
-
[39]
A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, T. Xiao, S. Whitehead, A. C. Berg, W.- Y. Lo, P. Dollár, R. Girshick, Segment anything, in: 2023 IEEE/CVF International Conference on Com- puter Vision (ICCV), IEEE, Paris, France, 2023, pp. 3992–4003
work page 2023
- [40]
-
[41]
Wenzel Jakob, Sébastien Speierer, Nicolas Roussel, Merlin Nimier-David, Delio Vicini, Tizian Zeltner, Baptiste Nicolet, Miguel Crespo, Vincent Leroy, Ziyi Zhang, Mitsuba 3 renderer (2022)
work page 2022
-
[42]
J. A. Duffie, W. A. Beckman, Solar Engineering of Thermal Processes, John Wiley & Sons, Inc., Hobo- ken, New Jersey, 2006. 22
work page 2006
-
[43]
R. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision, 2nd Edition, Cambridge University Press, 2003
work page 2003
- [44]
-
[45]
P. Ineichen, R. Perez, A new airmass independent for- mulation for the linke turbidity coefficient, Solar En- ergy 73 (3) (2002) 151–157
work page 2002
- [46]
-
[47]
I. Loshchilov, F. Hutter, Decoupled weight decay reg- ularization, in: International Conference on Learning Representations, 2019
work page 2019
-
[48]
Japanese city - midtown environ- ment, https://www.cgtrader.com/3d- models/exterior/cityscape/japanese-city-midtown- environment
-
[49]
J. M. Bright, Solcast: Validation of a satellite-derived solar irradiance dataset, Solar Energy 189 (2019) 435– 449
work page 2019
-
[50]
D. Yang, J. M. Bright, Worldwide validation of 8 satellite-derived and reanalysis solar radiation prod- ucts: A preliminary evaluation and overall metrics for hourly data over 27 years, Solar Energy 210 (2020) 3– 19
work page 2020
- [51]
-
[52]
NYC Office of Technology & Innovation, 3-D building model, https://data.cityofnewyork.us/City- Government/3-D-Building-Model/tnru-abg2
-
[53]
NYC Office of Technology & Innova- tion, 1 foot digital elevation model (dem), https://data.cityofnewyork.us/City-Government/1- foot-Digital-Elevation-Model-DEM-/dpc8-z3jc. 23
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.