REVIEW 3 major objections 5 minor 28 references
CarbonSet: A Dataset to Analyze Trends and Benchmark the Sustainability of CPUs and GPUs
T0 review · 3 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read A new dataset tracks CPU and GPU carbon footprints and shows AI demand pushed emissions past 50x the 2016 baseline.
desk verdict A genuinely useful first dataset for processor sustainability, whose headline 50x AI-boom number is built on an unvalidated shipment assumption and should be demoted pending sensitivity analysis. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is a probabilistic extension of the ECO-CHIP carbon-footprint model: instead of a single CFP value, CarbonSet produces a distribution of lifecycle carbon estimates by treating defect density, energy-per-area, carbon intensity, and gas-per-area as probability distributions, then running 10,000-sample Monte Carlo simulations. The mean of each distribution becomes the representative CFP per processor, letting the dataset support trend analyses and tradeoff metrics such as performance per CFP, embodied CFP per area (ECFPA), and performance per ECFPA.
What would settle it
A direct check would be to compare the paper's flagship-only shipment estimates against NVIDIA's actual unit-shipment disclosures or third-party teardown and procurement data for datacenter GPUs from 2016 to 2023; if total shipped units grew by, say, less than 20x while total CO2 still exceeded 50x the baseline, the conclusion that deployment volume dominates over per-chip efficiency would need revision.
Extended reading notes
Core claim
The paper discovers that flagship GPUs and CPUs remain far from sustainable design: operational carbon still dominates lifecycle emissions, but the share of embodied carbon is rising with advanced process nodes. Most strikingly, the authors estimate that datacenter GPU shipments, driven by AI demand, have pushed total CO2 emissions from these chips to more than 50 times their 2016 level, even though per-chip performance efficiency improved by roughly 120x over the same period. Additional findings include that manufacturing cost and selling price are not reliable proxies for embodied carbon; that extending processor lifetime into the multi-year range is needed to amortize embodied emissions, especially at high idle times; and that chiplet architectures are not universally more sustainable, with monolithic designs remaining preferable below roughly 200 $mm^{2}$ of chip area.
Load-bearing premise
The 50x total-emissions growth rests on estimating GPU shipments by assuming NVIDIA's datacenter revenue comes solely from selling the latest flagship GPU at its highest price with a 75% profit margin, so if the revenue actually includes non-GPU products, older architectures, or volume discounts, the shipment count and the 50x multiplier change.
Editorial extensions
If this is right
- If the 50x total-emissions estimate is right, reducing processor carbon requires addressing deployment growth and utilization, not only per-chip efficiency.
- The dataset enables Moore's-law-style trend analysis for sustainability, letting designers see which process-node or architecture choices actually lower lifecycle carbon.
- A fixed three-year, 60%-idle lifetime model means reported operational CFPs are comparable across chips, but real-world deployment choices can shift the balance between embodied and operational carbon.
- The chiplet analysis suggests that design-space exploration for sustainable chips should treat chiplet count as a tunable axis, with the optimal choice depending on total chip area.
- Because the dataset is public, it can serve as a common reference for companies estimating device lifetime carbon for life-cycle assessments and eco-labeling.
Reading between the lines
- The paper's 50x figure is an output of an assumption chain that treats NVIDIA datacenter revenue as coming solely from flagship GPU sales at a 75% margin and top list price; a more realistic revenue mix could change the multiplier, so the strongest reading is that total growth is very large rather than exactly 50x.
- The same probabilistic CFP methodology could be applied to other processor families, mobile SoCs, or future accelerator designs, extending CarbonSet's trend analysis beyond the flagship Intel and NVIDIA parts it currently highlights.
- A testable extension would be to weight the 50x estimate by actual datacenter GPU lifetimes and utilization data; if real deployment lifetimes are shorter than the assumed three years, the embodied-carbon share and the urgency of extending lifetimes would both increase.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. CarbonSet curates a dataset of over 1,000 CPUs and GPUs, evaluates their carbon footprint using a probabilistic extension of the ECO-CHIP model, and analyzes sustainability trends over roughly the last decade. The paper reports that single-chip CFP has not dramatically worsened, but that AI-driven shipment growth has made total processor CFP exceed 50× the 2016 baseline. It also presents case studies on manufacturing cost versus embodied CFP, lifetime amortization of embodied CFP, and chiplet versus monolithic manufacturing CFP. The dataset and the Monte Carlo modeling procedure are the paper's main contributions, and the trend analysis is framed as a Moore's-law-like sustainability benchmark.
Significance. If the central quantitative claims are validated, CarbonSet would be a useful community resource: it is the first large-scale processor-level sustainability benchmark with probabilistic CFP ranges, it uses external input distributions, and its performance-per-CFP and ECFPA metrics provide a concrete framework for carbon-aware design-space exploration. The authors are also careful to base their simulations on 10,000 Monte Carlo samples and to make the dataset available. However, the headline 50× total-CFP figure is not a direct measurement: it is computed from a stylized revenue-to-shipment reconstruction and from a per-chip CFP scaling for the H100 that is not described. The qualitative conclusion that shipment growth rather than per-chip CFP dominates recent total emissions may survive a more careful analysis, but the specific 50× multiplier is not robust as currently supported, and the paper does not quantify uncertainty in its trend plots even though it advertises a probabilistic model.
major comments (3)
- [4.3] The headline 50× total-CFP increase rests entirely on the shipment reconstruction in Section 4.3, where NVIDIA Datacenter revenue is assumed to come 'solely from the latest flagship GPU sales with a 75% profit margin while being sold at the highest price.' Each of these three assumptions has an unsigned bias: the Datacenter segment includes Mellanox networking, software, and non-flagship products, which would inflate GPU unit counts if all revenue is attributed to flagship silicon; using MSRP instead of realized system-level ASPs would deflate unit counts; and the role of the '75% profit margin' is never specified and is applied inconsistently with revenue-based accounting. The text defends the estimate as 'conservative' only on the ASP side. Because the total-CFP multiplier is the product of unit count and per-chip CFP, the paper needs a bounded sensitivity analysis over revenue mix, margin, and ASP before the abstract's 50× claim can be considered substantiated.
- [4.3, Footnote 1] The H100, which dominates the 2022–2023 window in Fig. 6, is assigned a 5 nm CFP by an undisclosed 'scaled based on existing process node metrics' procedure. Since manufacturing CFP enters per-chip CFP and therefore total CFP, the scaling formula, its calibration source, and the resulting uncertainty range must be reported. Without this, the late-window total-CFP trend is not reproducible and the 50× figure cannot be independently checked.
- [3.1, 4.1–4.6] Although Section 3.1 motivates a probabilistic model and Figure 3 shows overlapping CFP distributions for A100 and Xeon 8380, all subsequent trend analysis (Figures 4–6) uses only the mean CFP with no uncertainty band or propagation. The paper does not demonstrate whether its qualitative conclusions—such as V100 achieving roughly 2× performance/CFP over A100, or total CFP exceeding 50× the baseline—are preserved under the range of CFP values implied by its own Monte Carlo model. At a minimum, the final trends should report confidence or credible intervals, and the 50× statement should be given as a range rather than a point value.
minor comments (5)
- [6] The conclusion repeatedly writes 'CarboSet' instead of 'CarbonSet'; this typo should be corrected.
- [Figures 4–6] Several figure labels contain artifacts such as 'T otal CFP' and 'CFP Percentage'; these should be fixed for readability.
- [Figure 9 caption] The caption writes 'chiple CPUs'; this should be 'chiplet CPUs'.
- [3.2] The sentence introducing chiplet CPUs notes a uniform process node and equal die-area distribution, but the paper later treats this as an assumption for all AMD chiplet processors without checking vendor disclosures; this limitation should be reiterated where the chiplet case study is presented.
- [3.2] The performance metric choices are reasonable, but the text should explicitly explain why Passmark and Geekbench scores are treated as comparable within each category, since the two are not normalized to a common baseline.
Circularity Check
No circular derivation found: CFP values are computed from explicit external-input equations, and the 50x total-CFP claim is an output of a stated shipment reconstruction rather than a fitted target.
full rationale
The paper's derivation chain is self-contained in the relevant sense. Total CFP is computed from the ECO-CHIP equations (Eqs. 1-2) with input distributions sourced externally (TSMC defect/EPA reports, IMEC GPA, Our World in Data carbon intensity, Geekbench/PassMark performance data); the Monte Carlo procedure averages over these distributions and does not tune parameters to reproduce any headline result. The abstract's 50x total-CO2 claim is computed from NVIDIA datacenter revenue divided by an assumed flagship-ASP with a 75% margin, multiplied by modeled per-chip CFP (Sec. 4.3, Fig. 6); it is an output of an explicit assumption chain, not a fitted parameter, so it does not reduce to its inputs by construction. The ECO-CHIP framework is a self-citation (ref [23]) and is load-bearing as the model behind all CFP values, but the model equations are stated in the paper and its inputs are external, so the citation functions as provenance for an executable model rather than as an authority invoked to force the conclusion. Two limitations are worth flagging but are not circularity: the H100 5nm node is 'scaled based on existing process node metrics' rather than modeled (footnote after Sec. 4.3), and the shipment reconstruction assumes all datacenter revenue comes solely from latest flagship GPU sales at MSRP; these affect accuracy and uncertainty but do not make the derivation equivalent to its inputs. No step meets the quoted-evidence bar for self-definition, fitted-input-as-prediction, or self-citation-forcing.
Assumptions & free parameters
free parameters (8)
- Defect density D0 distribution =
KDE from TSMC 10nm defect reports
- Energy per unit area (EPA) distribution =
KDE from TSMC 10nm reports
- Carbon intensity distribution =
KDE from global electricity trends 2000-2024
- Gas per unit area (GPA) distribution =
Gaussian from IMEC fab emissions data
- Fixed processor lifetime =
3 years
- Fixed idle time =
60%
- NVIDIA profit margin assumption =
75%
- Alpha clustering parameter =
not stated in text
assumptions (6)
- domain assumption ECO-CHIP model correctly estimates lifecycle CFP as ECFP plus OCFP with manufacturing CFPA per Eq. 2
- ad hoc to paper NVIDIA datacenter revenue consists solely of latest flagship GPU sales at highest list price
- ad hoc to paper H100 5nm process node CFP can be scaled from existing process node metrics
- ad hoc to paper Chiplet CPUs have equal die area distribution and a uniform process node
- domain assumption TDP approximates operational power draw
- domain assumption Cross-benchmark comparability: Geekbench, PassMark, and OpenCL scores are valid performance measures within each series
Cite this review
Pith. "Pith review of CarbonSet: A Dataset to Analyze Trends and Benchmark the Sustainability of CPUs and GPUs." pith.science (2026). https://pith.science/paper/XEYSIZZB
@misc{pith2026250610373,
author = {Pith},
title = {Pith review of: CarbonSet: A Dataset to Analyze Trends and Benchmark the Sustainability of CPUs and GPUs},
year = {2026},
howpublished = {\url{https://pith.science/paper/XEYSIZZB}},
note = {Machine review of arXiv:2506.10373}
}
abstract
Over the years, the chip industry has consistently developed high-performance processors to address the increasing demands across diverse applications. However, the rapid expansion of chip production has significantly increased carbon emissions, raising critical concerns about environmental sustainability. While researchers have previously modeled the carbon footprint (CFP) at both system and processor levels, a holistic analysis of sustainability trends encompassing the entire chip lifecycle remains lacking. This paper presents CarbonSet, a comprehensive dataset integrating sustainability and performance metrics for CPUs and GPUs over the past decade. CarbonSet aims to benchmark and assess the design of next-generation processors. Leveraging this dataset, we conducted detailed analysis of flagship processors' sustainability trends over the last decade. This paper further highlights that modern processors are not yet sustainably designed, with total carbon emissions increasing more than 50$\times$ in the past three years due to the surging demand driven by the AI boom. Power efficiency remains a significant concern, while advanced process nodes pose new challenges requiring to effectively amortize the dramatically increased manufacturing carbon emissions.
Figures
Figures from the paper (5 more)
Reference graph
Works this paper leans on
-
[1]
D. S. Berger, D. Brooks, F. Kazhamiaka, M. D. Hill, R. Bianchini, C.-J. Wu, K. Strauss, K. Frost, J. Wang, K. Martins, S. Gillett, E. Choukse, D. Ernst, R. Fonseca, K. Lio, B. Narayanasetty, P. Patel, C. Irvene, A. Sriraman, G. Porter, A. Jones, U. Gupta, B. Acun-Uyan, K. Hazelwood, and D. Carmean. [n. d.]. Embodied Carbon is Important. https://www.sigarc...
work page 2024
-
[2]
Anvita Bhagavathula, Leo Han, and Udit Gupta. 2024. Understanding the Impli- cations of Uncertainty in Embodied Carbon Models for Sustainable Computing. In HotCarbon
work page 2024
-
[3]
Andrew A. Chien. [n. d.]. Why Embodied Carbon is a poor Architec- ture Design metric, and Operational Carbon remains an important Prob- lem. https://www.sigarch.org/why-embodied-carbon-is-a-poor-architecture- design-metric-and-operational-carbon-remains-an-important-problem/ Ac- cessed: 2024-11-19
work page 2024
-
[4]
Chetan Choppali Sudarshan, Aman Arora, and Vidya A Chhabria. 2024. GreenF- PGA: Evaluating FPGAs as Environmentally Sustainable Computing Solutions. In Proceedings of the 61st ACM/IEEE Design Automation Conference . 1–6
work page 2024
-
[5]
NVIDIA Corporation. 2024. Financial Reports. https://investor.nvidia.com/ Home/default.aspx Accessed: 2024-11-19
work page 2024
- [6]
-
[7]
Exxact. 2022. Run:ai: You’ve got Idle GPUs. We Guarantee It. https://www.exxactcorp.com/blog/Deep-Learning/run-ai-you-ve-got-idle- gpus-we-guarantee-it Accessed: 2024-11-19
work page 2022
-
[8]
Geekbench. 2024. Geekbench-Processor Benchmark. https://browser.geekbench. com/processor-benchmarks Accessed: 2024-11-19
work page 2024
Show all 28 references
-
[9]
Georgia, Butler. 2023. Study: Only 13% of provisioned CPUs and 20% of memory utilized in cloud computing. https://www.datacenterdynamics.com/ en/news/only-13-of-provisioned-cpus-and-20-of-memory-utilized-in-cloud- computing-report/ Accessed: 2024-11-19
2023
-
[10]
Lee, David Brooks, and Carole-Jean Wu
Udit Gupta, Mariam Elgamal, Gage Hills, Gu-Yeon Wei, Hsien-Hsin S. Lee, David Brooks, and Carole-Jean Wu. 2022. ACT: designing sustainable computer systems with an architectural carbon modeling tool. In Proceedings of the 49th Annual International Symposium on Computer Archite...
2022
-
[11]
Lee, Gu- Yeon Wei, David Brooks, and Carole-Jean Wu
Udit Gupta, Young Geun Kim, Sylvia Lee, Jordan Tse, Hsien-Hsin S. Lee, Gu- Yeon Wei, David Brooks, and Carole-Jean Wu. 2022. Chasing Carbon: The Elusive Environmental Footprint of Computing. IEEE Micro 42, 4 (2022), 37–
2022
-
[12]
Peter Henderson, Jieru Hu, Joshua Romoff, Emma Brunskill, Dan Jurafsky, and Joelle Pineau. 2020. Towards the systematic reporting of the energy and carbon footprints of machine learning. J. Mach. Learn. Res. 21, 1, Article 248 (Jan. 2020), 43 pages
2020
-
[13]
Chris Hendrickson, Arpad Horvath, Satish Joshi, Octavio Juarez, Lester Lave, H Scott Matthews, Francis C McMichael, and Elisa Cobas-Flores. 1998. Economic Input-Output-Based Life Cycle Assessment (EIO-LCA). mental (1998)
1998
-
[14]
Bernd Hoefflinger. 2012. ITRS: The International Technology Roadmap for Semicon- ductors. Springer Berlin Heidelberg, Berlin, Heidelberg, 161–174. doi:10.1007/978- 3-642-23096-7_7
2012 doi
-
[15]
Ian Cutress. 2020. Better Yield on 5nm than 7nm: TSMC Update on Defect Rates for N5. https://www.anandtech.com/show/16028/better-yield-on-5nm-than- 7nm-tsmc-update-on-defect-rates-for-n5 Accessed: 2024-11-19
2020
-
[16]
Chhabria, A.Arora
J.Hu, C.C Sudarshan, V.A. Chhabria, A.Arora. 2025. CarbonSet GitHub. https: //github.com/advent-lab/CarbonSet Accessed: 2025-4-19
2025
-
[17]
Marie Garcia Bardon. [n. d.]. The environmental footprint of logic CMOS tech- nologies. https://www.imec-int.com/en/articles/environmental-footprint-logic- cmos-technologies Accessed: 2024-11-19
2024
-
[18]
Patterson, Hanlin Tang, Gu-Yeon Wei, Peter Bailis, Vic- tor Bittorf, David Brooks, Dehao Chen, Debojyoti Dutta, Udit Gupta, Kim M
Peter Mattson, Christine Cheng, Cody Coleman, Greg Diamos, Paulius Mi- cikevicius, David A. Patterson, Hanlin Tang, Gu-Yeon Wei, Peter Bailis, Vic- tor Bittorf, David Brooks, Dehao Chen, Debojyoti Dutta, Udit Gupta, Kim M. Hazelwood, Andrew Hock, Xinyuan Huang, Bill Jia, Danie...
2019 arXiv
-
[19]
Our World Data. 2024. Carbon intensity of electricity generation. https://tinyurl. com/carbon-intensity-world Accessed: 2024-11-19
2024
-
[20]
PassMark. 2024. PassMark-Processor Performance Test. https://www.passmark. com/products/performancetest/ Accessed: 2024-11-19
2024
-
[21]
Standard Performance Evaluation Corporation. 2024. SPEC Benchmarks and Tools. https://www.spec.org/benchmarks.html Accessed: 2024-11-19
2024
-
[22]
C. C. Sudarshan, A. Arora, and V. A Chhabria. 2024. Beyond the Surface: The Necessity of Detailed Metrics in Corporate Sustainability. In Proc. of the 15th International Green and Sustainable Computing Conference (Austin, US) (IGSCC ’24)
2024
-
[23]
Sapat- nekar, and Vidya A
Chetan Choppali Sudarshan, Nikhil Matkar, Sarma Vrudhula, Sachin S. Sapat- nekar, and Vidya A. Chhabria. 2024. ECO-CHIP: Estimation of Carbon Footprint of Chiplet-based Architectures for Sustainable VLSI . In 2024 IEEE International Symposium on High-Performance Computer Archi...
2024
-
[24]
Yifan Sun, Nicolas Bohm Agostini, Shi Dong, and David R. Kaeli. 2019. Summa- rizing CPU and GPU Design Trends with Product Data. CoRR abs/1911.11313 (2019). arXiv:1911.11313 http://arxiv.org/abs/1911.11313
2019 arXiv
-
[25]
TSMC. 2019. Corporate Socual Responsibility Report 2019. https://esg.tsmc. com/download/csr/2019-csr-report/english/pdf/e-all.pdf Accessed: 2024-11-19
2019
-
[26]
Amin Vahdat, Xiaoyu Ma, and David Patterson. 2024. New Computer Evaluation Metrics for a Changing World. Commun. ACM 67, 10 (Sept. 2024), 31–33. doi:10. 1145/3637867
2024
-
[27]
Lee, Bugra Akyildiz, Maximilian Balandat, Joe Spisak, Ravi Jain, Mike Rabbat, and Kim M
Carole-Jean Wu, Ramya Raghavendra, Udit Gupta, Bilge Acun, Newsha Ardalani, Kiwan Maeng, Gloria Chang, Fiona Aga Behram, James Huang, Charles Bai, Michael Gschwind, Anurag Gupta, Myle Ott, Anastasia Melnikov, Salvatore Candido, David Brooks, Geeta Chauhan, Benjamin Lee, Hsien-...
2021 arXiv
-
[47]
doi:10.1109/MM.2022.3163226
2022
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.